-- Logs begin at Wed 2022-05-11 17:47:57 UTC, end at Wed 2022-05-11 19:17:16 UTC. -- May 11 18:48:41.723638 dv-cinder-755101-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 18:48:41.732247 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 18:48:41 2022] *** May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: nodename: dv-cinder-755101-8-iscsi May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: machine: x86_64 May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: clock source: unix May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: pcre jit disabled May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: detected number of CPU cores: 4 May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: current working directory: / May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: detected binary path: /usr/bin/uwsgi-core May 11 18:48:41.734086 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: your processes number limit is 47680 May 11 18:48:41.734814 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: your memory page size is 4096 bytes May 11 18:48:41.734814 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: detected max file descriptor number: 2048 May 11 18:48:41.734814 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: lock engine: pthread robust mutexes May 11 18:48:41.734814 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: thunder lock: enabled May 11 18:48:41.734814 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 18:48:41.734814 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 18:48:41.779117 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: Python main interpreter initialized at 0x557b9b76f9c0 May 11 18:48:41.779117 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: python threads support enabled May 11 18:48:41.779117 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: your server socket listen backlog is limited to 100 connections May 11 18:48:41.779117 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: your mercy for graceful operations on workers is 90 seconds May 11 18:48:41.779527 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: mapped 403077 bytes (393 KB) for 2 cores May 11 18:48:41.779527 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: *** Operational MODE: preforking *** May 11 18:48:41.779793 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: *** uWSGI is running in multiple interpreter mode *** May 11 18:48:41.779793 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: spawned uWSGI master process (pid: 102558) May 11 18:48:41.779976 dv-cinder-755101-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 18:48:41.781025 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: spawned uWSGI worker 1 (pid: 102559, cores: 1) May 11 18:48:41.781025 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: spawned uWSGI worker 2 (pid: 102560, cores: 1) May 11 18:48:41.781025 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 18:48:42.974350 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 18:48:42.980278 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 18:48:43.701668 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:48:43.701668 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: from cryptography.utils import int_from_bytes May 11 18:48:43.701994 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:48:43.701994 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: from cryptography.utils import int_from_bytes May 11 18:48:43.704271 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:48:43.704271 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: from cryptography.utils import int_from_bytes May 11 18:48:43.704600 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:48:43.704600 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: from cryptography.utils import int_from_bytes May 11 18:48:46.294941 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 18:48:46.295488 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 18:48:46.295688 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 18:48:46.296062 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 18:48:46.296152 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 18:48:46.296241 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 18:48:46.296327 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 18:48:46.296471 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 18:48:46.296705 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.296833 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 18:48:46.297033 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.297126 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 18:48:46.297356 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.297475 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.297677 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.297809 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298012 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298138 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298328 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298461 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298651 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298798 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.298976 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.299118 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.299328 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.299468 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.299603 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.299798 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.299918 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.300133 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.300248 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-8-iscsi {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.300400 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.300575 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.300723 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.300892 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.301054 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-8-iscsi {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.301205 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.301387 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.301532 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.301703 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.301842 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.302020 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.302168 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.302346 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.302519 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.302660 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.302970 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.303072 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.303308 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.303443 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.303752 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.303845 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.304067 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.304161 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.304414 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.304554 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.304719 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.304805 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.305034 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.305120 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.305358 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.305456 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.305672 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.305762 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306003 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306108 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306333 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306438 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306646 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306755 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-8-iscsi {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.306964 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.307052 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.307346 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.307435 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-8-iscsi {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.307668 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.307755 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.308005 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.308091 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.308329 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.308472 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.308690 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.308785 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.309014 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.309108 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.309343 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.309441 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.309679 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.309805 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310011 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310098 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310325 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310411 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310644 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310729 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.310972 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.311066 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.311278 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.311378 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.311616 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.311715 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.311929 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312037 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312243 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312332 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312551 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312645 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.312954 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.313117 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.313213 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.313429 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.313514 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.313974 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314077 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314289 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314385 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314618 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314704 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314878 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.314964 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.315134 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.315269 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.315482 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.315587 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.315792 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.315879 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.316107 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.316200 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.316420 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.316560 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.316731 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.316824 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317042 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317127 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317352 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317446 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317662 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317749 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.317971 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.318056 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.318283 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.318377 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.318599 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.318698 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.318913 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319007 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319236 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319575 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319672 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319903 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.319987 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.320221 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.320307 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.320543 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.320636 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.320861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.320946 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.321189 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.321275 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.321507 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.321613 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.321821 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.321927 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.322141 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.322228 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.322466 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.322552 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.322780 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.322874 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.323091 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.323178 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.323431 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.323532 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.323749 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.323845 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324068 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324168 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324375 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324459 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324631 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324728 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.324940 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.325026 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.325297 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.325394 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.325608 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.325703 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.325919 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326005 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326232 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326317 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326545 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326666 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326852 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.326938 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.327163 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.327247 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.327497 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.327585 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.327812 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.327922 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.328121 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.328226 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.328431 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.328522 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.328737 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.328824 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329047 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329144 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329358 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329452 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329665 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329751 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.329976 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.330069 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.330296 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.330385 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.330605 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.330690 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.330919 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331022 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331228 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331333 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331564 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331652 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.331988 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.332188 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.332277 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.332497 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.332586 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.332814 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.332902 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.333121 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.333209 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.333446 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.333534 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.333897 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.334218 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.334599 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.334919 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.335234 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.335714 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.336040 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.336426 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.336599 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.336743 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.336960 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.337057 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.337300 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.337398 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.337645 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.337733 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.337960 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338046 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338274 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338369 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338589 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338674 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338901 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.338992 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.339214 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.339327 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.339550 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.339637 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.339865 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.339951 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.340183 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.340279 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.340499 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.340585 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.341337 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.341492 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.341650 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.341737 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.341962 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.342058 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.342289 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.342379 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.342619 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.342710 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.342935 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.343032 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.343249 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.343367 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.343587 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.343684 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.343920 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:48:46.344010 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.344262 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.344360 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.344586 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.344673 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.344911 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345000 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345248 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345348 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345566 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345655 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345887 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.345984 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.346209 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.346298 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.346531 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.346633 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.346856 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.346957 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.347193 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.347289 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.347539 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.347633 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.347860 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.347974 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.348180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.348282 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.348497 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.348587 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.348819 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.348907 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.349153 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.349243 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.349475 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.349565 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.349793 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.349893 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.350115 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.350216 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.350432 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.350546 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.350759 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.350848 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.351094 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.351184 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.351443 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.351546 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.351765 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.351851 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.352086 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.352181 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.352407 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.352498 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.352737 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.352910 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.353070 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.353160 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.353390 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.353478 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.353706 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.353810 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354024 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354119 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354337 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354426 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354655 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354799 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.354974 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.355066 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.355315 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.355404 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.355639 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.355741 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.355959 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.356054 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.356298 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.356448 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.357131 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.357237 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.357450 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.357538 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.357768 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.357863 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.358089 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.358176 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.358411 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.358497 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.358727 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.358813 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.359044 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.359138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.359383 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.359492 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.359702 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.359788 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360015 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360102 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360329 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360415 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360641 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360731 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.360973 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.361059 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.361292 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.361377 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.361608 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.361712 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.361921 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362008 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362243 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362348 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362563 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362660 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362874 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.362969 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.363193 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.363287 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.363537 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.363637 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.363854 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.363942 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.364172 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.364256 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.364493 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.364593 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.364810 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.364902 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.365126 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.365210 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.365443 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.365529 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.365755 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.365839 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.366075 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.366166 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.366389 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.366475 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.366702 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.366794 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367018 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367102 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367350 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367449 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367665 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367750 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.367985 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.368084 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.368298 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.368385 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.368617 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.368702 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.368933 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369028 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369250 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369336 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369579 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369664 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369898 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.369996 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.370216 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.370303 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.370528 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.370663 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.370853 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.370950 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.371168 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.371254 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.371521 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.371608 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.371838 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.371927 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.372188 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.372295 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.372501 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.372606 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.372812 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.372906 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.373121 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.373206 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.373433 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.373517 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.373744 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.373843 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374065 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374153 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374377 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374463 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374689 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374776 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.374994 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.375080 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.375337 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.375467 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.375654 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.375865 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.376083 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.376277 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.376448 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.376600 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.376758 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.376912 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.377077 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.377422 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.377808 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.378105 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.378359 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.378602 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.378805 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.378970 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.379085 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.379181 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.379407 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.379513 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.379750 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.379854 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.380097 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.380336 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.380499 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.380585 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.380739 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.380874 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.381065 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.381155 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.381391 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.381484 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.381712 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.381810 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.382034 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.382127 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.382365 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.382463 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.382683 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.382781 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.383008 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.383101 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.383347 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.383449 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.383684 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.383777 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384010 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384105 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384337 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384429 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384652 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384753 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.384975 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.385069 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.385295 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.385381 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.385620 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.385720 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.385942 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386035 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386261 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386354 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386579 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386677 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386899 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.386985 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.387214 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.387326 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.387557 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.388167 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.388391 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.388487 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.388710 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.388849 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389035 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389129 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389350 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389445 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389674 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389766 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.389985 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.390094 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.390317 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.390419 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.390633 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.390720 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.390957 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.391058 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.391268 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.391398 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.391611 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.391707 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.391931 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392024 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392255 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392341 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392573 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392705 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392890 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.392992 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.393206 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.393298 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.393523 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.393623 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.393841 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.393927 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.394159 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.394245 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.394473 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.394574 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.394785 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.394880 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.395102 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.395197 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.395443 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.395548 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.395755 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.395850 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.396067 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.396154 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.396379 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.396477 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.396697 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.396790 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397013 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397107 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397322 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397415 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397630 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397717 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.397939 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398038 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398264 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398406 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398578 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398671 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398892 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.398983 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.399205 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.399312 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.399538 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.399633 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.399849 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.399934 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.400177 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.400273 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.400488 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.400575 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.400795 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.400892 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.401104 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.401190 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.401416 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.401509 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.401750 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.401846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.402060 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.402152 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.402373 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.402466 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.402692 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.402831 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.403013 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.403099 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.403918 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404017 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404241 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404343 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404556 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404649 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404872 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.404957 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.405195 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.405282 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.405510 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.405603 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.405823 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.405915 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.406139 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.406233 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.406455 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.406547 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.406766 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.406861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.407078 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.407165 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.407429 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.407532 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.407744 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408006 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408102 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408347 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408483 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408656 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408743 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.408970 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.409056 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.409292 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.409377 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.409615 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.409855 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.409954 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.410190 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.410275 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.410512 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.410598 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.410834 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.410938 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.411160 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.411250 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.411510 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.411604 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.411845 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.411930 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.412166 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.412265 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.412481 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.412568 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.412797 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.412942 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.413109 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.413202 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.413420 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.413506 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.413732 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.413818 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414047 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414147 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414355 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414441 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414665 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414752 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.414977 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.415073 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.415287 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.415411 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.415618 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.415710 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.415929 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416026 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416233 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416317 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416544 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416630 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416860 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.416955 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.417167 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.417252 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.417478 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.417564 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.417782 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.417874 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.418110 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.418202 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.418422 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.418547 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.418730 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.418840 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.419060 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.419154 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.419392 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.419502 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.419738 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.419842 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.420047 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.420138 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.420389 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.420485 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.420708 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.420793 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421022 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421156 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421343 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421443 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421653 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421738 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.421966 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422063 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422277 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422371 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422587 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422679 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422896 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.422983 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.423212 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.423362 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.423549 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.423643 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.423862 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.423948 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.424175 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.424262 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.424499 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.424585 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.424812 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.424897 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.425123 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.425209 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.425430 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.425524 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.425745 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.425831 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426056 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426155 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426366 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426457 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426675 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426769 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.426983 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.427069 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.427289 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.427394 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.427625 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.427729 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.427936 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428029 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428241 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428333 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428553 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428696 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.428955 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.429172 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.429256 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.429477 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.429571 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.429785 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.429872 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.430092 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.430178 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.430405 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.430494 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.430717 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.430802 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431027 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431112 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431371 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431464 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431688 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431774 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.431998 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.432083 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.432308 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.432396 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.432620 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.432706 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.432929 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433017 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433236 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433332 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433548 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433633 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433866 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.433961 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.434184 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.434278 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.434514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.434603 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.434825 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.434928 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.435132 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.435225 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.435465 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.435565 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.435777 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.435872 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.436086 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.436171 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.436393 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.436479 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.436699 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.436794 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437004 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437139 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437314 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437401 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437621 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437714 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.437946 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.438035 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.438257 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.438344 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.438568 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.438944 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.439132 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.439227 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.439475 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.439564 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.439822 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.439910 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.440133 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.440226 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.440452 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.440536 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.440777 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.440872 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.441095 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.441179 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.441413 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.441507 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.441725 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.441811 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442036 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442130 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442349 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442444 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442659 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442746 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.442975 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.443060 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.443287 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.443429 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.443630 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.443716 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.443940 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444025 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444248 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444342 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444571 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444657 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444887 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.444971 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.445199 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.445293 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.445513 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.445599 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.445833 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.445925 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.446158 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.446249 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.446468 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.446553 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.446780 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.446914 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.447098 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.447235 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.447431 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.447531 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.447747 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.447833 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.448059 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.448144 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.448373 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.448458 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.448688 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.448779 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449000 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449086 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449315 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449447 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449630 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449726 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.449941 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.450523 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.450776 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.450862 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.451089 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.451184 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.451424 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.451739 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.451825 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452054 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452193 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452364 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452517 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452676 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452839 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.452985 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.453155 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.453297 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.453476 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.453604 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.453796 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454038 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454125 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454354 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454438 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454669 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454754 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.454980 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.455138 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.455310 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.455528 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.455629 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.455805 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.455933 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.456124 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.456250 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.456438 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.456560 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.456751 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.456979 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.457074 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.457294 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.457381 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.457609 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.457704 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.457923 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458018 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458233 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458318 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458541 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458636 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458855 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.458942 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.459182 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.459267 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.459516 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.459642 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.459825 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.459962 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.460134 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.460276 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.460463 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.460698 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.460792 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.461022 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.461115 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.461340 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.461499 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.461671 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.461815 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462000 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462124 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462330 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462541 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462634 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462857 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.462944 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.463172 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.463259 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.463526 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.463637 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.463860 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.463947 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.464186 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.464273 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.464494 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.464587 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.464812 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.464906 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.465126 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.465213 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.465453 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.465539 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.466304 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.466401 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.466639 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.466731 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.466957 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.467057 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.467268 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.467415 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.467629 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.467729 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.467958 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.468057 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.468275 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.468367 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.468601 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.468695 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.468946 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469040 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469265 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469351 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469579 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469666 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469893 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.469992 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.470225 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.470325 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.470540 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.470636 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.470845 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.470931 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.471159 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.471245 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.471494 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.471593 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.471806 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.471894 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.472117 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.472209 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.472442 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.472527 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.472754 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.472841 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.473066 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.473151 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.473378 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.473463 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.473695 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.473782 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474005 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474091 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474318 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474411 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474635 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474720 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.474951 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475036 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475263 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475392 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475598 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475693 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475912 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.475998 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.476221 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.476315 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.476549 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.476635 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.476862 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.476954 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.477170 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.477265 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.477478 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.477565 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.477787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.477873 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.478131 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.478219 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.478444 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.478530 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.478769 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.478855 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.479093 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.479180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.479444 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.479533 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.479758 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.479843 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.480073 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.480163 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.480391 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.480477 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.480702 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.480795 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481015 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481104 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481360 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481453 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481672 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481820 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.481984 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482071 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482295 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482381 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482602 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482697 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482908 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.482994 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.483220 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.483320 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.483564 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.483664 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.483874 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.483962 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.484182 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.484270 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.484490 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.484585 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.484800 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.484894 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.485111 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.485197 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.485438 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.485526 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.485752 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.485838 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.486062 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.486147 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.486372 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.486459 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.486682 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.486768 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.487024 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.487109 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.487350 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.487442 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.487691 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.487778 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488008 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488093 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488329 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488416 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488651 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488745 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.488961 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.489055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.489279 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.489371 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.489597 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.489683 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.489912 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490011 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490226 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490319 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490544 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490631 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490862 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.490956 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.491178 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.491419 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.491521 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.491758 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.491885 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.492082 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.492171 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.492404 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.492491 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.492726 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.492821 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493050 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493244 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493371 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493578 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493689 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493898 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.493994 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.494215 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.494302 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.494530 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.494616 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.494850 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.494938 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.495166 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.495253 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.495506 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.495612 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.495821 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.495908 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.496136 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.496222 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.496450 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.496545 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.496781 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.496867 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.497134 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.497221 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.497466 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.497562 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.497802 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.497889 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.498122 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.498208 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.498440 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.498527 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.498766 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.498859 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.499091 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.499178 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.499440 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.499579 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.499764 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.499864 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.500087 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.500183 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.500407 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.500500 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.500724 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.500816 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501042 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501137 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501359 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501455 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501677 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501764 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.501995 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.502098 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.502312 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.502399 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.502629 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.502715 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.502944 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.503032 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.503266 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.503367 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.503608 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.503704 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.503936 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.504132 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.504275 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.504454 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.504600 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.504797 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.504919 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.505131 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.505239 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.505467 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.505554 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.505791 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.506065 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.506151 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.506385 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.506470 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.506723 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.506818 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.507034 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.507122 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.507389 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.507481 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.507710 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.507853 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508024 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508117 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508351 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508439 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508670 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508764 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.508983 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.509078 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.509300 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.509388 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.509616 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.509709 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.509926 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.510160 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.510251 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.510518 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.510614 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.510843 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.510930 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.511163 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.511248 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.511505 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.511609 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.511845 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.512042 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.512164 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.512393 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.512488 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.513233 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.513321 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.513572 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.513659 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.513904 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514000 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514227 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514313 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514541 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514627 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514857 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.514953 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.515168 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.515253 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.515507 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.515595 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.515822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.515922 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.516133 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.516218 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.516444 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.516530 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.516753 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.516840 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.517069 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.517155 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.517383 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.517479 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.517694 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.517782 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518003 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518098 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518314 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518401 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518626 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518713 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.518941 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519034 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519248 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519362 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519585 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519673 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519899 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.519986 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.520207 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.520293 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.520519 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.520605 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.520825 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.520917 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.521136 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.521231 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.521448 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.521534 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.521759 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.521851 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.522072 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.522211 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.522382 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.522476 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.522695 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.522783 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.523006 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.523104 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.523336 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.523439 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.523681 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.523767 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524003 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524103 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524309 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524394 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524618 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524703 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.524937 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.525025 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.525249 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.525492 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.525589 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.525839 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.525934 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.526169 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.526258 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.526508 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.526595 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.526823 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.526920 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.527149 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.527391 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.527480 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.527736 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.527840 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.528063 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.528173 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.528968 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.529060 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.529287 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.529382 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.529609 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.529695 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.529921 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530007 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530236 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530367 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530552 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530639 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530868 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.530960 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.531184 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.531358 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.531526 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.531613 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.531842 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.531928 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.532155 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.532287 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.532469 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.532556 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.532783 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.532870 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.533102 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.533190 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.533416 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.533504 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.533738 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.533824 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.534053 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.534141 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.534370 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.534456 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.534687 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.534782 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535007 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535093 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535344 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535445 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535666 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535766 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.535989 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.536077 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.536326 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.536414 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.536651 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.536748 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.536962 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.537049 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.537276 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.537383 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.537592 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.537708 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.537911 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.538035 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.538245 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.538365 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.538565 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.538683 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.538874 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.539016 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.539339 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.539431 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.539631 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.539719 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.539955 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.540043 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.540291 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.540387 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.540606 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.540700 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.540936 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541022 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541264 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541360 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541591 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541691 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541903 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.541990 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.542217 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.542311 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.542527 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.542613 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.542844 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.542930 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.543171 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.543259 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.543513 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.543600 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.543854 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.543943 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.544166 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.544254 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.544478 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.544565 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.544791 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.544877 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.545102 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.545190 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.545415 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.545501 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.545725 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.545810 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546037 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546124 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546346 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546432 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546654 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546752 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.546963 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.547049 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.547273 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.547391 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.547605 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.547702 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.547917 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548004 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548225 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548312 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548533 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548628 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548839 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.548924 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.549149 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.549242 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.549457 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.549552 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.549762 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.549847 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550074 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550160 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550381 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550478 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550690 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550776 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.550998 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.551084 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.551318 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.551409 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.551638 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.551724 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.551974 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.552061 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.552310 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.552406 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.552629 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.552715 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.552950 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553035 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553263 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553357 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553593 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553680 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553905 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.553999 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.554223 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.554310 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.554545 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.554631 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.554859 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555015 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555173 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555259 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555514 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555613 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555833 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.555932 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.556148 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.556235 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.556466 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.556558 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.556778 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.556880 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.557093 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.557179 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.557407 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.557493 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.557731 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.557818 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.558051 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.558137 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.558359 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.558444 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.558689 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.558778 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.559005 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.559090 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.559346 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.559466 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.559688 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.559784 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560003 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560097 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560326 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560424 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560638 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560724 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.560953 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561039 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561272 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561367 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561587 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561675 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561902 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.561989 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.562222 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.562318 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.562540 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.562626 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.562871 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.562958 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.563201 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.563289 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.563560 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.563902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.564133 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.564220 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.564448 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.564536 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.564699 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 18:48:46.564792 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.565113 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.565444 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.565766 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.566084 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.566395 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:48:46.566641 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 18:48:46.588597 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_db.sqlalchemy.engines [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.590138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_db.sqlalchemy.engines [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.651890 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.context [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40d0ea05-af06-458f-98eb-de2bb03f4480(cell1) {{(pid=102559) load_cells /opt/stack/nova/nova/context.py:464}} May 11 18:48:46.652926 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.context [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40d0ea05-af06-458f-98eb-de2bb03f4480(cell1) {{(pid=102560) load_cells /opt/stack/nova/nova/context.py:464}} May 11 18:48:46.656827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:48:46.657790 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_concurrency.lockutils [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:48:46.658698 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:48:46.659375 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_concurrency.lockutils [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:48:46.659537 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:48:46.660166 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_concurrency.lockutils [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:48:46.661531 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:48:46.662065 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_concurrency.lockutils [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:48:46.672869 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_db.sqlalchemy.engines [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.675822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_db.sqlalchemy.engines [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.679799 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_db.sqlalchemy.engines [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.682585 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_db.sqlalchemy.engines [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.836531 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_db.sqlalchemy.engines [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:46.841589 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG oslo_db.sqlalchemy.engines [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:48:47.175854 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: WARNING keystonemiddleware.auth_token [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:48:47.178787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: WARNING keystonemiddleware.auth_token [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:48:47.183171 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: WARNING keystonemiddleware.auth_token [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:48:47.187599 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: WARNING keystonemiddleware.auth_token [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:48:47.525321 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: WARNING keystonemiddleware.auth_token [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:48:47.531462 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: WARNING keystonemiddleware.auth_token [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:48:47.532360 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: WARNING keystonemiddleware.auth_token [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:48:47.537418 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b9b76f9c0 pid: 102559 (default app) May 11 18:48:47.539272 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: WARNING keystonemiddleware.auth_token [None req-051a889d-f76c-419d-8b11-0d9c38bfe379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:48:47.539518 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:48:47.540670 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 May 11 18:48:47.541075 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Wed May 11 18:48:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:48:47.544486 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b9b76f9c0 pid: 102560 (default app) May 11 18:50:05.551468 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:05.552488 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 11 18:50:05.553028 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:05.980687 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-02405b28-4436-40e1-98bc-017baa326dcc admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:06.009517 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-02405b28-4436-40e1-98bc-017baa326dcc admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449777 May 11 18:50:06.010301 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 1/3] 10.222.0.93 () {60 vars in 1291 bytes} [Wed May 11 18:50:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:50:08.300843 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:08.302362 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-d21647dc-3514-4ace-9478-ce07f274e07d None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001917 May 11 18:50:08.307518 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 3/4] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:08.361541 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2ebe7228-36e0-45d0-8c61-3c3be2635d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:08.390741 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:50:08.390741 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: warnings.warn(msg) May 11 18:50:08.424853 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2ebe7228-36e0-45d0-8c61-3c3be2635d8f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116024 May 11 18:50:08.425743 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 2/5] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:08.639807 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-d2f75099-d5c8-40cb-876e-05e50002117e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:08.642237 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:50:08.642237 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: warnings.warn(msg) May 11 18:50:08.688799 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-d2f75099-d5c8-40cb-876e-05e50002117e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.255266 May 11 18:50:08.689567 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 4/6] 10.222.0.93 () {64 vars in 1335 bytes} [Wed May 11 18:50:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:50:10.946019 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2ebe7228-36e0-45d0-8c61-3c3be2635d8f admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:10.947035 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2ebe7228-36e0-45d0-8c61-3c3be2635d8f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 11 18:50:10.947485 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 3/7] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:11.050406 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-476efa6e-912a-40ec-9a4d-287c1b43d7e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:11.068233 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:50:11.068233 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: warnings.warn(msg) May 11 18:50:11.086111 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-476efa6e-912a-40ec-9a4d-287c1b43d7e2 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132493 May 11 18:50:11.086706 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 5/8] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:11.098823 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-905192be-89ff-43cd-ac9c-e23afdf8323a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:11.100335 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:50:11.100335 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: warnings.warn(msg) May 11 18:50:11.132782 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-905192be-89ff-43cd-ac9c-e23afdf8323a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037525 May 11 18:50:11.133259 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 4/9] 10.222.0.93 () {64 vars in 1335 bytes} [Wed May 11 18:50:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:50:13.374299 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-476efa6e-912a-40ec-9a4d-287c1b43d7e2 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:13.375323 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-476efa6e-912a-40ec-9a4d-287c1b43d7e2 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 11 18:50:13.375774 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:13.433664 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-9b0c6cb1-8ad8-439d-aba6-60b1a57c66a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "id": "d2", "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:13.453074 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-9b0c6cb1-8ad8-439d-aba6-60b1a57c66a5 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071488 May 11 18:50:13.453778 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 5/11] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 18:50:13.465860 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-13ad4ca0-aa7a-411f-b76c-530de1bbcf62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:13.490065 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-13ad4ca0-aa7a-411f-b76c-530de1bbcf62 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028086 May 11 18:50:13.490789 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 7/12] 10.222.0.93 () {64 vars in 1335 bytes} [Wed May 11 18:50:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:50:15.800709 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-9b0c6cb1-8ad8-439d-aba6-60b1a57c66a5 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:15.801751 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-9b0c6cb1-8ad8-439d-aba6-60b1a57c66a5 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 11 18:50:15.802152 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 6/13] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:15.858963 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-dfc203e3-beaa-4758-8e34-ad283bd3f135 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "disk": 10, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:15.877197 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-dfc203e3-beaa-4758-8e34-ad283bd3f135 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069444 May 11 18:50:15.877751 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 8/14] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:15.889688 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-835f1773-a6a6-4496-877d-6a0794d5bd6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:15.913697 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-835f1773-a6a6-4496-877d-6a0794d5bd6d admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027790 May 11 18:50:15.914296 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 7/15] 10.222.0.93 () {64 vars in 1335 bytes} [Wed May 11 18:50:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:50:18.211647 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-dfc203e3-beaa-4758-8e34-ad283bd3f135 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:18.213147 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-dfc203e3-beaa-4758-8e34-ad283bd3f135 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 May 11 18:50:18.213579 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 9/16] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:18.274941 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-56d53159-f1c9-4a9f-9947-ac32282f089b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "d4"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:18.292480 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-56d53159-f1c9-4a9f-9947-ac32282f089b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072272 May 11 18:50:18.294070 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 8/17] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:18.305438 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-16b57a24-5f1c-428f-a9e2-64bb30a5fbb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:18.328926 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-16b57a24-5f1c-428f-a9e2-64bb30a5fbb4 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026956 May 11 18:50:18.329483 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 10/18] 10.222.0.93 () {64 vars in 1335 bytes} [Wed May 11 18:50:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:50:20.598643 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-56d53159-f1c9-4a9f-9947-ac32282f089b admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:20.599695 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-56d53159-f1c9-4a9f-9947-ac32282f089b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 11 18:50:20.600101 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 9/19] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:20.660629 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-343195d5-a0f4-4999-865f-996ffb21c9ac admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:20.684506 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-343195d5-a0f4-4999-865f-996ffb21c9ac admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077555 May 11 18:50:20.685061 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 11/20] 10.222.0.93 () {60 vars in 1291 bytes} [Wed May 11 18:50:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:50:23.117774 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-56d53159-f1c9-4a9f-9947-ac32282f089b admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:23.118852 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-56d53159-f1c9-4a9f-9947-ac32282f089b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 11 18:50:23.119269 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 10/21] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:23.185477 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-2cfe0dc9-4592-4d39-824d-49b675a04002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "id": "1"}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:23.205331 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-2cfe0dc9-4592-4d39-824d-49b675a04002 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079758 May 11 18:50:23.206461 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 12/22] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 18:50:23.220381 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-d5092aab-9a5c-4fc0-b790-8339d31c3001 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:23.244795 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-d5092aab-9a5c-4fc0-b790-8339d31c3001 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028539 May 11 18:50:23.245374 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 11/23] 10.222.0.93 () {64 vars in 1332 bytes} [Wed May 11 18:50:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:50:25.872639 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-2cfe0dc9-4592-4d39-824d-49b675a04002 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:25.873653 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-2cfe0dc9-4592-4d39-824d-49b675a04002 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 11 18:50:25.874070 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 13/24] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:25.932189 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-6194ba58-c244-4eef-a93b-96997a851053 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "swap": 0}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:25.951020 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-6194ba58-c244-4eef-a93b-96997a851053 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071190 May 11 18:50:25.951644 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 12/25] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:25.963207 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-9f2a21fa-2046-4fa3-ae47-f942ea484e8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:25.985376 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-9f2a21fa-2046-4fa3-ae47-f942ea484e8d admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025776 May 11 18:50:25.986134 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 14/26] 10.222.0.93 () {64 vars in 1332 bytes} [Wed May 11 18:50:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:50:28.686485 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-6194ba58-c244-4eef-a93b-96997a851053 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:28.687621 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-6194ba58-c244-4eef-a93b-96997a851053 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 May 11 18:50:28.688103 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:28.746281 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-27c4cabd-b1be-4ef5-a167-fac855eb456c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "disk": 40, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:28.764055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-27c4cabd-b1be-4ef5-a167-fac855eb456c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069958 May 11 18:50:28.764627 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 15/28] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:28.776030 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-41bd6243-6326-4668-9558-7d3c9e3edc4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:28.797776 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-41bd6243-6326-4668-9558-7d3c9e3edc4c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025352 May 11 18:50:28.798331 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 14/29] 10.222.0.93 () {64 vars in 1332 bytes} [Wed May 11 18:50:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:50:31.083984 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-27c4cabd-b1be-4ef5-a167-fac855eb456c admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:31.084992 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-27c4cabd-b1be-4ef5-a167-fac855eb456c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 11 18:50:31.085403 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 16/30] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:31.143837 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-3c49b92b-7c27-40c9-bc15-e18e3b601da6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:31.175457 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-3c49b92b-7c27-40c9-bc15-e18e3b601da6 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083663 May 11 18:50:31.176009 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 15/31] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 18:50:31.187904 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-ba8f3963-a2d0-4694-a7d1-77d56b1c2b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:31.216056 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-ba8f3963-a2d0-4694-a7d1-77d56b1c2b8b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032074 May 11 18:50:31.217220 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 17/32] 10.222.0.93 () {64 vars in 1332 bytes} [Wed May 11 18:50:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:50:33.506393 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-3c49b92b-7c27-40c9-bc15-e18e3b601da6 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:33.507506 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-3c49b92b-7c27-40c9-bc15-e18e3b601da6 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 11 18:50:33.511954 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 16/33] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:33 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:33.571426 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-37c90b51-6490-45be-838d-fb2179457a9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "swap": 0}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:33.591006 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-37c90b51-6490-45be-838d-fb2179457a9e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076715 May 11 18:50:33.591916 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 18/34] 10.222.0.93 () {64 vars in 1282 bytes} [Wed May 11 18:50:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:50:33.603549 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-3e096a33-dd2c-4dbd-95c7-ea8cb3fa5c3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:50:33.629224 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-3e096a33-dd2c-4dbd-95c7-ea8cb3fa5c3a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029535 May 11 18:50:33.629940 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 17/35] 10.222.0.93 () {64 vars in 1332 bytes} [Wed May 11 18:50:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:50:57.010332 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-37c90b51-6490-45be-838d-fb2179457a9e admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:57.011369 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-37c90b51-6490-45be-838d-fb2179457a9e admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 11 18:50:57.011768 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 19/36] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:57.068546 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-36206d2d-a5eb-4ffb-97e9-98af909b9920 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:57.084974 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-36206d2d-a5eb-4ffb-97e9-98af909b9920 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067270 May 11 18:50:57.085497 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 18/37] 10.222.0.93 () {60 vars in 1291 bytes} [Wed May 11 18:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:50:58.085889 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-37c90b51-6490-45be-838d-fb2179457a9e admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:58.086889 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-37c90b51-6490-45be-838d-fb2179457a9e admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 11 18:50:58.087585 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 20/38] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:58.286701 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-a6066c9c-538c-4e12-92ad-acc1fb5c44db admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:58.292220 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.wsgi [None req-a6066c9c-538c-4e12-92ad-acc1fb5c44db admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-a6066c9c-538c-4e12-92ad-acc1fb5c44db admin admin] Request method failure captured: May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Accept: application/json May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Accept-Encoding: gzip, deflate May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Connection: keep-alive May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Content-Length: 0 May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Host: 10.222.0.93 May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Openstack-Api-Version: compute 2.90 May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Openstack-System-Scope: None May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: User-Agent: python-novaclient May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Auth-Token: gAAAAABifAWSOVq91AnR0BgUNgvR1bdbQ8nF3IPtXq4pUh0um6pSfTt2o-BYRuy6E-N2Lnn5npHZWLtk1qyiw69pYuySbLY_qMlBcpP-m-8fREbgBa2MFL3BN492ucqUA1YxeWV32ZQTXYcoNZRKSqpaC6JbVM9L9DFzsb-8snVC-QSY8zA-Jnc May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Domain-Id: None May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Domain-Name: None May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Identity-Status: Confirmed May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Is-Admin-Project: True May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Openstack-Nova-Api-Version: 2.90 May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Domain-Id: default May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Domain-Name: Default May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Name: admin May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Role: reader,admin,member May 11 18:50:58.296068 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Roles: reader,admin,member May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_639dcabe7cb941cc82eb0b4e6f620fd4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant: admin May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant-Name: admin May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User: admin May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Domain-Id: default May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Domain-Name: Default May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Id: 2e7cd529baa6412fbb8c3f6158f7ed52 May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Name: admin May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: method: > May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: exception: Flavor 42 could not be found. May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: action_args: {'id': '42'} May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:50:58.297787 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:58.298649 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:58.299861 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-a6066c9c-538c-4e12-92ad-acc1fb5c44db admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:50:58.300869 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-a6066c9c-538c-4e12-92ad-acc1fb5c44db admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060531 May 11 18:50:58.300869 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 19/39] 10.222.0.93 () {60 vars in 1190 bytes} [Wed May 11 18:50:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 18:50:58.307200 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-448357ea-2237-4472-b468-0939dd9cf940 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:58.328809 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-448357ea-2237-4472-b468-0939dd9cf940 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025167 May 11 18:50:58.329336 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 21/40] 10.222.0.93 () {60 vars in 1210 bytes} [Wed May 11 18:50:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:50:58.338646 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-5e9af32e-3612-4cc2-ab3e-4f3b763d6512 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:58.360224 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-5e9af32e-3612-4cc2-ab3e-4f3b763d6512 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025085 May 11 18:50:58.360760 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1210 bytes} [Wed May 11 18:50:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:50:58.369668 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-b7c3e6f1-f6a5-420f-9d95-fea5a093b4dd admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:58.375109 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.wsgi [None req-b7c3e6f1-f6a5-420f-9d95-fea5a093b4dd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-b7c3e6f1-f6a5-420f-9d95-fea5a093b4dd admin admin] Request method failure captured: May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Accept: application/json May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Accept-Encoding: gzip, deflate May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Connection: keep-alive May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Content-Length: 0 May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Host: 10.222.0.93 May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Openstack-Api-Version: compute 2.90 May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Openstack-System-Scope: None May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: User-Agent: python-novaclient May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Auth-Token: gAAAAABifAWSOVq91AnR0BgUNgvR1bdbQ8nF3IPtXq4pUh0um6pSfTt2o-BYRuy6E-N2Lnn5npHZWLtk1qyiw69pYuySbLY_qMlBcpP-m-8fREbgBa2MFL3BN492ucqUA1YxeWV32ZQTXYcoNZRKSqpaC6JbVM9L9DFzsb-8snVC-QSY8zA-Jnc May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Domain-Id: None May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Domain-Name: None May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Identity-Status: Confirmed May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Is-Admin-Project: True May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Openstack-Nova-Api-Version: 2.90 May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Domain-Id: default May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Domain-Name: Default May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Name: admin May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Role: reader,admin,member May 11 18:50:58.378372 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Roles: reader,admin,member May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_639dcabe7cb941cc82eb0b4e6f620fd4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant: admin May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant-Name: admin May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User: admin May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Domain-Id: default May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Domain-Name: Default May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Id: 2e7cd529baa6412fbb8c3f6158f7ed52 May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Name: admin May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: method: > May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: exception: Flavor 42 could not be found. May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: action_args: {'id': '42'} May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:50:58.379878 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:58.380827 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:58.382055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-b7c3e6f1-f6a5-420f-9d95-fea5a093b4dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:50:58.383210 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-b7c3e6f1-f6a5-420f-9d95-fea5a093b4dd admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013543 May 11 18:50:58.383210 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 22/42] 10.222.0.93 () {60 vars in 1190 bytes} [Wed May 11 18:50:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 18:50:59.286568 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-5e9af32e-3612-4cc2-ab3e-4f3b763d6512 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:59.287613 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-5e9af32e-3612-4cc2-ab3e-4f3b763d6512 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 11 18:50:59.288178 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 21/43] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:50:59.474195 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-2e46d10c-729c-4c62-af83-970850cbc4a6 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:59.479401 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.wsgi [None req-2e46d10c-729c-4c62-af83-970850cbc4a6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-2e46d10c-729c-4c62-af83-970850cbc4a6 admin admin] Request method failure captured: May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Accept: application/json May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Accept-Encoding: gzip, deflate May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Connection: keep-alive May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Content-Length: 0 May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Host: 10.222.0.93 May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Openstack-Api-Version: compute 2.90 May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Openstack-System-Scope: None May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: User-Agent: python-novaclient May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Auth-Token: gAAAAABifAWTBR1ncn3d-s1cSx3izyO_fku4_AFzMlBRlVbxkFKK0EFy2ouLA_GCQ8ReUbfiRZECD3BnYlEfoGmGS_PXJWLb3IKq4Xsokl1Li3xRrBrXGlWlkBMto4gZjAOTdsny3_FOSdXa6y801G9TT0aKiib_ONL5qpglKm_YdcXXB8zU3Nc May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Domain-Id: None May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Domain-Name: None May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Identity-Status: Confirmed May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Is-Admin-Project: True May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Openstack-Nova-Api-Version: 2.90 May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Domain-Id: default May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Domain-Name: Default May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Name: admin May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Role: reader,admin,member May 11 18:50:59.480902 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Roles: reader,admin,member May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_639dcabe7cb941cc82eb0b4e6f620fd4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant: admin May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant-Name: admin May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User: admin May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Domain-Id: default May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Domain-Name: Default May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Id: 2e7cd529baa6412fbb8c3f6158f7ed52 May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Name: admin May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: method: > May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: exception: Flavor 84 could not be found. May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: action_args: {'id': '84'} May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:50:59.482328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:59.483341 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:50:59.484822 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-2e46d10c-729c-4c62-af83-970850cbc4a6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:50:59.486089 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-2e46d10c-729c-4c62-af83-970850cbc4a6 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059555 May 11 18:50:59.486089 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 23/44] 10.222.0.93 () {60 vars in 1190 bytes} [Wed May 11 18:50:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 18:50:59.491881 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-ed49ec25-9e12-4366-bd77-346d05415317 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:59.505628 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-ed49ec25-9e12-4366-bd77-346d05415317 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017305 May 11 18:50:59.506155 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1210 bytes} [Wed May 11 18:50:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:50:59.515722 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-fb07a43a-5460-442b-9722-8554cce233a4 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:59.528995 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-fb07a43a-5460-442b-9722-8554cce233a4 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017317 May 11 18:50:59.529506 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 24/46] 10.222.0.93 () {60 vars in 1210 bytes} [Wed May 11 18:50:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:50:59.538278 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-ed48493a-b3ce-4b23-8466-c40874faebd2 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:50:59.543352 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.wsgi [None req-ed48493a-b3ce-4b23-8466-c40874faebd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-ed48493a-b3ce-4b23-8466-c40874faebd2 admin admin] Request method failure captured: May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Accept: application/json May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Accept-Encoding: gzip, deflate May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Connection: keep-alive May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Content-Length: 0 May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Host: 10.222.0.93 May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Openstack-Api-Version: compute 2.90 May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Openstack-System-Scope: None May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: User-Agent: python-novaclient May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Auth-Token: gAAAAABifAWTBR1ncn3d-s1cSx3izyO_fku4_AFzMlBRlVbxkFKK0EFy2ouLA_GCQ8ReUbfiRZECD3BnYlEfoGmGS_PXJWLb3IKq4Xsokl1Li3xRrBrXGlWlkBMto4gZjAOTdsny3_FOSdXa6y801G9TT0aKiib_ONL5qpglKm_YdcXXB8zU3Nc May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Domain-Id: None May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Domain-Name: None May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Identity-Status: Confirmed May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Is-Admin-Project: True May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Openstack-Nova-Api-Version: 2.90 May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Domain-Id: default May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Domain-Name: Default May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Name: admin May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Role: reader,admin,member May 11 18:50:59.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Roles: reader,admin,member May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_639dcabe7cb941cc82eb0b4e6f620fd4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant: admin May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant-Name: admin May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User: admin May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Domain-Id: default May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Domain-Name: Default May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Id: 2e7cd529baa6412fbb8c3f6158f7ed52 May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Name: admin May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: method: > May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: exception: Flavor 84 could not be found. May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: action_args: {'id': '84'} May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:50:59.546320 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:59.547138 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:50:59.548180 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-ed48493a-b3ce-4b23-8466-c40874faebd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:50:59.549146 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-ed48493a-b3ce-4b23-8466-c40874faebd2 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011326 May 11 18:50:59.549146 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 23/47] 10.222.0.93 () {60 vars in 1190 bytes} [Wed May 11 18:50:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 18:51:00.436603 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-fb07a43a-5460-442b-9722-8554cce233a4 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:00.437605 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-fb07a43a-5460-442b-9722-8554cce233a4 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 11 18:51:00.438002 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 25/48] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:51:00.632837 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-1fa5e156-5cc9-4f4c-9cab-f9bcbc455ca0 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:00.638500 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.wsgi [None req-1fa5e156-5cc9-4f4c-9cab-f9bcbc455ca0 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-1fa5e156-5cc9-4f4c-9cab-f9bcbc455ca0 admin admin] Request method failure captured: May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Accept: application/json May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Accept-Encoding: gzip, deflate May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Connection: keep-alive May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Content-Length: 0 May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Host: 10.222.0.93 May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Openstack-Api-Version: compute 2.90 May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Openstack-System-Scope: None May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: User-Agent: python-novaclient May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Auth-Token: gAAAAABifAWUrWisVQMBngC-J4KeMCVo6AdSP-qMt4zkvwlMSNhLJp5Jp37ITxx2K-6FR0HsBG2O6IGFYvZdAFnyqC9unxmWCCpKGSrJfPh8wQIKPJFrOivrcTbCRDA-UcwGdzLYXbOUP-KkPivH_Q09znNhnZ6ETWSFTxRWO1U2fFKMjGtTPBY May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Domain-Id: None May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Domain-Name: None May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Identity-Status: Confirmed May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Is-Admin-Project: True May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Openstack-Nova-Api-Version: 2.90 May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Domain-Id: default May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Domain-Name: Default May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Project-Name: admin May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Role: reader,admin,member May 11 18:51:00.640022 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Roles: reader,admin,member May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_639dcabe7cb941cc82eb0b4e6f620fd4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant: admin May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-Tenant-Name: admin May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User: admin May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Domain-Id: default May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Domain-Name: Default May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Id: 2e7cd529baa6412fbb8c3f6158f7ed52 May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: X-User-Name: admin May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: method: > May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: exception: Flavor 451 could not be found. May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: action_args: {'id': '451'} May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:51:00.641514 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:51:00.642434 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: ERROR nova.api.openstack.wsgi May 11 18:51:00.643794 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-1fa5e156-5cc9-4f4c-9cab-f9bcbc455ca0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:51:00.645037 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-1fa5e156-5cc9-4f4c-9cab-f9bcbc455ca0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063309 May 11 18:51:00.645037 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 24/49] 10.222.0.93 () {60 vars in 1193 bytes} [Wed May 11 18:51:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 18:51:00.651195 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-75d972b8-31e0-4174-b696-6b5dad0d91ef admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:00.664521 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-75d972b8-31e0-4174-b696-6b5dad0d91ef admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016845 May 11 18:51:00.665041 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 26/50] 10.222.0.93 () {60 vars in 1210 bytes} [Wed May 11 18:51:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:51:00.674860 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:00.689156 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017786 May 11 18:51:00.689687 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 25/51] 10.222.0.93 () {60 vars in 1210 bytes} [Wed May 11 18:51:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:51:00.699181 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-fd2775e9-1a64-4fcc-8d96-339fa19346da admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:00.704317 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.wsgi [None req-fd2775e9-1a64-4fcc-8d96-339fa19346da admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-fd2775e9-1a64-4fcc-8d96-339fa19346da admin admin] Request method failure captured: May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Accept: application/json May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Accept-Encoding: gzip, deflate May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Connection: keep-alive May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Content-Length: 0 May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Host: 10.222.0.93 May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Openstack-Api-Version: compute 2.90 May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Openstack-System-Scope: None May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: User-Agent: python-novaclient May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Auth-Token: gAAAAABifAWUrWisVQMBngC-J4KeMCVo6AdSP-qMt4zkvwlMSNhLJp5Jp37ITxx2K-6FR0HsBG2O6IGFYvZdAFnyqC9unxmWCCpKGSrJfPh8wQIKPJFrOivrcTbCRDA-UcwGdzLYXbOUP-KkPivH_Q09znNhnZ6ETWSFTxRWO1U2fFKMjGtTPBY May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Domain-Id: None May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Domain-Name: None May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Identity-Status: Confirmed May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Is-Admin-Project: True May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Openstack-Nova-Api-Version: 2.90 May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Domain-Id: default May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Domain-Name: Default May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Project-Name: admin May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Role: reader,admin,member May 11 18:51:00.705779 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Roles: reader,admin,member May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_639dcabe7cb941cc82eb0b4e6f620fd4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/639dcabe7cb941cc82eb0b4e6f620fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant: admin May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant-Id: 639dcabe7cb941cc82eb0b4e6f620fd4 May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-Tenant-Name: admin May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User: admin May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Domain-Id: default May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Domain-Name: Default May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Id: 2e7cd529baa6412fbb8c3f6158f7ed52 May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: X-User-Name: admin May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: method: > May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: exception: Flavor 451 could not be found. May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: action_args: {'id': '451'} May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:51:00.707335 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:51:00.708262 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: ERROR nova.api.openstack.wsgi May 11 18:51:00.709257 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-fd2775e9-1a64-4fcc-8d96-339fa19346da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:51:00.710218 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-fd2775e9-1a64-4fcc-8d96-339fa19346da admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011550 May 11 18:51:00.710218 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 27/52] 10.222.0.93 () {60 vars in 1193 bytes} [Wed May 11 18:51:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 18:51:01.589449 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:01.590447 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 11 18:51:01.590841 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 26/53] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:51:01.775050 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-fc87bae2-e4d3-45c9-b369-da86399d443c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:51:01.793064 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-fc87bae2-e4d3-45c9-b369-da86399d443c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067783 May 11 18:51:01.793592 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 28/54] 10.222.0.93 () {64 vars in 1235 bytes} [Wed May 11 18:51:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:51:02.690274 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:02.691838 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 11 18:51:02.692251 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:51:02.879961 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-69eb7a57-a56e-49e6-a5c9-ecedaf28f9ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:51:02.897130 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-69eb7a57-a56e-49e6-a5c9-ecedaf28f9ef admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068245 May 11 18:51:02.897665 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 29/56] 10.222.0.93 () {64 vars in 1235 bytes} [Wed May 11 18:51:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:51:03.782352 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:03.783405 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 11 18:51:03.783813 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 28/57] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:51:03.971323 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-248b4b40-3e8e-4c87-8d28-228c794ea536 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:51:03.988524 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-248b4b40-3e8e-4c87-8d28-228c794ea536 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067275 May 11 18:51:03.989043 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 30/58] 10.222.0.93 () {64 vars in 1235 bytes} [Wed May 11 18:51:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:51:04.895017 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:04.896044 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 11 18:51:04.896459 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 29/59] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:51:05.087524 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-0f2bef54-8ca2-4a27-9cc6-c396d062f522 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:51:05.105657 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-0f2bef54-8ca2-4a27-9cc6-c396d062f522 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069422 May 11 18:51:05.106126 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 31/60] 10.222.0.93 () {64 vars in 1235 bytes} [Wed May 11 18:51:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:51:06.006667 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:06.007722 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 11 18:51:06.008142 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 30/61] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:51:06.210344 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-29f95ef8-b200-4ef9-b324-06589f43281b admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:51:06.230118 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-29f95ef8-b200-4ef9-b324-06589f43281b admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083369 May 11 18:51:06.230585 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 32/62] 10.222.0.93 () {60 vars in 1202 bytes} [Wed May 11 18:51:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:52:08.447217 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:52:08.448308 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-0d49af98-a293-4ede-abda-c30d623091cb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 11 18:52:08.448738 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 31/63] 10.222.0.93 () {54 vars in 930 bytes} [Wed May 11 18:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:52:08.505782 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-8ad77d8e-4287-4e7c-8b18-f0f1828cd65c admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:52:08.524245 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-8ad77d8e-4287-4e7c-8b18-f0f1828cd65c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069785 May 11 18:52:08.524775 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 33/64] 10.222.0.93 () {60 vars in 1291 bytes} [Wed May 11 18:52:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:52:08.547919 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-322ddc14-db6a-4f31-94cb-a96a852bdbcc admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:52:08.556979 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-322ddc14-db6a-4f31-94cb-a96a852bdbcc admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013476 May 11 18:52:08.557498 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 32/65] 10.222.0.93 () {60 vars in 1282 bytes} [Wed May 11 18:52:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:52:08.568733 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-c6cba8db-767a-4521-b8fb-627f4292c1e8 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:52:08.576061 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-c6cba8db-767a-4521-b8fb-627f4292c1e8 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011056 May 11 18:52:08.576568 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 34/66] 10.222.0.93 () {60 vars in 1285 bytes} [Wed May 11 18:52:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:52:08.587237 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:52:08.594943 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011234 May 11 18:52:08.595491 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 33/67] 10.222.0.93 () {60 vars in 1285 bytes} [Wed May 11 18:52:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:52:08.606735 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-a0fbadd2-ec1f-47dc-96bb-db0d4ab8cc44 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:52:08.613975 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-a0fbadd2-ec1f-47dc-96bb-db0d4ab8cc44 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011209 May 11 18:52:08.614476 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 35/68] 10.222.0.93 () {60 vars in 1282 bytes} [Wed May 11 18:52:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:55:31.167664 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:31.168691 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 11 18:55:31.169083 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:55:31.437152 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-d456a8dd-bb57-43c8-b58e-134147f1c051 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:31.438328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:55:31.438328 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: warnings.warn(msg) May 11 18:55:31.439544 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d456a8dd-bb57-43c8-b58e-134147f1c051 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:31.439987 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d456a8dd-bb57-43c8-b58e-134147f1c051 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:31.440766 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d456a8dd-bb57-43c8-b58e-134147f1c051 admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:31.441196 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-d456a8dd-bb57-43c8-b58e-134147f1c051 admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:31.478527 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-d456a8dd-bb57-43c8-b58e-134147f1c051 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155682 May 11 18:55:31.479094 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 36/70] 10.222.0.93 () {60 vars in 1193 bytes} [Wed May 11 18:55:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:55:32.362293 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:32.363345 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 11 18:55:32.363765 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 35/71] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:55:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:55:32.549821 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-c44b3396-98c9-4907-aac7-4f032f2d4e30 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:32.551001 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:55:32.551001 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: warnings.warn(msg) May 11 18:55:32.552293 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-c44b3396-98c9-4907-aac7-4f032f2d4e30 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:32.552737 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-c44b3396-98c9-4907-aac7-4f032f2d4e30 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:32.553523 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-c44b3396-98c9-4907-aac7-4f032f2d4e30 admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:32.553954 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-c44b3396-98c9-4907-aac7-4f032f2d4e30 admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:32.573837 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-c44b3396-98c9-4907-aac7-4f032f2d4e30 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073839 May 11 18:55:32.574374 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 37/72] 10.222.0.93 () {60 vars in 1193 bytes} [Wed May 11 18:55:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:55:43.909431 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:43.910444 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 11 18:55:43.910843 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 36/73] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:55:44.102750 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-3389bc78-90d4-4b43-a7de-03747ba529a4 admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:44.104055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:55:44.104055 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: warnings.warn(msg) May 11 18:55:44.105225 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-3389bc78-90d4-4b43-a7de-03747ba529a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:44.105663 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-3389bc78-90d4-4b43-a7de-03747ba529a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:44.106441 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-3389bc78-90d4-4b43-a7de-03747ba529a4 admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:44.106866 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-3389bc78-90d4-4b43-a7de-03747ba529a4 admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:44.130454 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-3389bc78-90d4-4b43-a7de-03747ba529a4 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078236 May 11 18:55:44.130932 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 38/74] 10.222.0.93 () {60 vars in 1193 bytes} [Wed May 11 18:55:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:55:45.020183 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: DEBUG nova.api.openstack.wsgi [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] Calling method '>' {{(pid=102560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:45.021186 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: INFO nova.api.openstack.requestlog [None req-2c568d83-c327-4163-8752-484188d0c698 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 11 18:55:45.021579 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: [pid: 102560|app: 0|req: 37/75] 10.222.0.93 () {56 vars in 1074 bytes} [Wed May 11 18:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:55:45.211626 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG nova.api.openstack.wsgi [None req-32bda82a-aaef-4ee0-87ab-df14c581adfe admin admin] Calling method '>' {{(pid=102559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:55:45.212836 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:55:45.212836 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: warnings.warn(msg) May 11 18:55:45.214020 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-32bda82a-aaef-4ee0-87ab-df14c581adfe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:45.214510 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-32bda82a-aaef-4ee0-87ab-df14c581adfe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:45.215284 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-32bda82a-aaef-4ee0-87ab-df14c581adfe admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:55:45.215757 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: DEBUG oslo_concurrency.lockutils [None req-32bda82a-aaef-4ee0-87ab-df14c581adfe admin admin] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:55:45.237933 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: INFO nova.api.openstack.requestlog [None req-32bda82a-aaef-4ee0-87ab-df14c581adfe admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077676 May 11 18:55:45.238405 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: [pid: 102559|app: 0|req: 39/76] 10.222.0.93 () {60 vars in 1193 bytes} [Wed May 11 18:55:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:56:43.837865 dv-cinder-755101-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 11 18:56:43.838397 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: Wed May 11 18:56:43 2022 - graceful shutdown triggered... May 11 18:56:43.838851 dv-cinder-755101-8-iscsi devstack@n-api.service[102560]: Gracefully killing worker 2 (pid: 102560)... May 11 18:56:43.839343 dv-cinder-755101-8-iscsi devstack@n-api.service[102559]: Gracefully killing worker 1 (pid: 102559)... May 11 18:56:44.839475 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: worker 1 buried after 1 seconds May 11 18:56:44.839475 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: worker 2 buried after 1 seconds May 11 18:56:44.840098 dv-cinder-755101-8-iscsi devstack@n-api.service[102558]: goodbye to uWSGI. May 11 18:56:44.841062 dv-cinder-755101-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 11 18:56:44.841619 dv-cinder-755101-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 11 18:56:44.844367 dv-cinder-755101-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 18:56:44.860699 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 18:56:44 2022] *** May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: nodename: dv-cinder-755101-8-iscsi May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: machine: x86_64 May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: clock source: unix May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: pcre jit disabled May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: detected number of CPU cores: 4 May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: current working directory: / May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: detected binary path: /usr/bin/uwsgi-core May 11 18:56:44.880792 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: your processes number limit is 47680 May 11 18:56:44.881614 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: your memory page size is 4096 bytes May 11 18:56:44.881614 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: detected max file descriptor number: 2048 May 11 18:56:44.881614 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: lock engine: pthread robust mutexes May 11 18:56:44.881614 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: thunder lock: enabled May 11 18:56:44.881614 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 18:56:44.881614 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 18:56:44.926327 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: Python main interpreter initialized at 0x5637f11fc9c0 May 11 18:56:44.926327 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: python threads support enabled May 11 18:56:44.926327 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: your server socket listen backlog is limited to 100 connections May 11 18:56:44.926327 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: your mercy for graceful operations on workers is 90 seconds May 11 18:56:44.926752 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: mapped 403077 bytes (393 KB) for 2 cores May 11 18:56:44.926752 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: *** Operational MODE: preforking *** May 11 18:56:44.927020 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: *** uWSGI is running in multiple interpreter mode *** May 11 18:56:44.927020 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: spawned uWSGI master process (pid: 117083) May 11 18:56:44.927228 dv-cinder-755101-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 18:56:44.928317 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: spawned uWSGI worker 1 (pid: 117096, cores: 1) May 11 18:56:44.928668 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: spawned uWSGI worker 2 (pid: 117097, cores: 1) May 11 18:56:44.929014 dv-cinder-755101-8-iscsi devstack@n-api.service[117083]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 18:56:46.136311 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 18:56:46.150089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 18:56:46.934689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:56:46.934689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: from cryptography.utils import int_from_bytes May 11 18:56:46.935021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:56:46.935021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: from cryptography.utils import int_from_bytes May 11 18:56:46.952793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:56:46.952793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: from cryptography.utils import int_from_bytes May 11 18:56:46.953181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:56:46.953181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: from cryptography.utils import int_from_bytes May 11 18:56:49.412176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 18:56:49.412724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 18:56:49.413013 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 18:56:49.413382 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 18:56:49.413647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 18:56:49.414082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.414419 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.414751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.415082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.415445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.415766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.416096 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.416433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.416768 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.417036 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.417369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.417700 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-8-iscsi {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.418031 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.418347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.418667 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.418996 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.419317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.419681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.419999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.420507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.421887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.421887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.421887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.422294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.422539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.422880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.423195 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.423560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.423877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.424203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.424611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-8-iscsi {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.424937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.425061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 18:56:49.425488 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.425576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 18:56:49.425656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.425915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 18:56:49.426045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.426239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 18:56:49.426461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.426721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 18:56:49.426955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.427171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.427457 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.427703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.427950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.427950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.428374 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.428554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.428780 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.429479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.429639 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.429825 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.430006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.430168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.430315 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.430468 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.430655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.430845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.431002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.431165 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.431350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.431518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.431676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.431822 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.432045 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-8-iscsi {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.432209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.432363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.432509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.432661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.432814 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.433005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.433163 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.433321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.433477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.433650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.433807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.434012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.434178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.434366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.434523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.434523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.434860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.435040 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.435190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.436683 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.436860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437494 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437798 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.437941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.438096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.438252 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.438408 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.438561 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.438706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.438908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.439060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.439216 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.439394 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.439544 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.439707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-8-iscsi {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.439874 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440179 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.440793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.441116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.441289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.441585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.441763 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.441948 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.442100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.442313 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.442458 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.442686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.442874 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443361 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443682 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.443990 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.444390 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.444548 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.445323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.445487 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.446151 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.446307 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.446461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.446634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.446965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.447142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.447336 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.447491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.447647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.447799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.447958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.448121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.448275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.448427 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.448580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.448731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.448895 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449360 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449826 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.449989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.450137 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.450281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.450432 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.450590 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.450737 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.450881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451044 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451197 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451361 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.451984 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.452142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.452286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.452440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.452586 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.452738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.452912 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.453577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.453750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.453750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.454049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.454196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.454196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.454487 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455590 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455861 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.455938 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456008 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456205 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456492 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456562 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456902 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.456979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457210 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457210 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457413 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457413 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457548 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457772 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.457911 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458316 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458574 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458702 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.458976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.459099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.459332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.459669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.459996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.460349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.460676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.460979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.461162 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.461337 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.461607 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.461928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.462135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.462247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.462516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.462625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.462864 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.462971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.463185 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.463311 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.463564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.463663 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.463900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.464012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.464221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.464338 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.464541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.464639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.464861 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.465025 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.465178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.465327 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.465501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.465659 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.465812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.465956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.466112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.466282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.466434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.466578 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.466754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.466905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.467073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.467231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.467410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.467567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.467719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.467864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.468067 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.468233 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.468390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.468533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.468675 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.468818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.468968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.469126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.469293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.469480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.469654 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.469816 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.470008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.471253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.472060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.472228 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.472384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.474531 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.474709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.474862 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.475009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.475204 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.475401 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.475978 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.477136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.477299 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.477455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.477621 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.477767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.477925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.478077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.478229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.478394 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.480844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.481517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.481679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.481829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.481975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.482130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:56:49.482283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.482427 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.482572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.482714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.482864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.483984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.484143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.484294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.484610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.484771 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.484927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.485081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.485233 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.485384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.485547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.485794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.485964 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.486140 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.486343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.486494 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.486638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.486790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.486945 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.487088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.487277 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.487479 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.487734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.487903 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488065 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488426 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488536 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.488894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.489016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.489208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.489356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.489513 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.489712 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.489870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.490014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.490176 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.490960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.490960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.491342 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492192 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492678 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492840 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.492998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.493188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.493343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.493503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.493654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.493803 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.493961 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.494120 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.494271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.494429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.494586 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.494743 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.494904 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.495063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.495214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.495214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.495564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.495722 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496315 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496773 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.496931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.497101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.497266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.497266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.497550 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.497708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.497867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498348 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.498956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.499131 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.499283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.499283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.499616 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.499766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.499922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.500142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.500308 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.500838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.501246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.501412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.501564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.501740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.501740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502035 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502190 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502815 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.502964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.503113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.503262 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.503472 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.503632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.503794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.503944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.504102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.504252 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.504415 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.504574 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.504724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.504881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.505032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.505188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.505347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.505497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.505646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.505819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.506057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.506229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.506387 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.506539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.506689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.506845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.507004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.507776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.507936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.508674 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.508924 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.509080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.509262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.509422 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.509573 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.509737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.509897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.510073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.510235 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.510399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.510569 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.511419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.511596 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.511761 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.511913 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512372 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512673 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512822 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.512973 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.513131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.513411 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.513567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.513736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.513896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514822 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.514972 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.515134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.515285 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.515477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.515628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.515799 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.515950 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.516208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.516375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.516526 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.516681 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.516831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.516987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.517148 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.517299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.517455 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.517612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.517769 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.517943 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.518100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.518252 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.518410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.518559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.518716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.518880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.519030 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.519191 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.519420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.519587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.520392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.520571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.520736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.521369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.521653 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.521813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.521972 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.522133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.522285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.522285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.522616 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.522809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.522959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.523122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.523273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.523483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.523619 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.523757 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.523908 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524192 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524797 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.524939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525079 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525825 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.525966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.526106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.526333 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.526473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.526628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.526770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.526911 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527665 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.527953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528093 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528247 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528395 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528543 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.528840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529412 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529552 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.529995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.530141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.530275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.530422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.530576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.530726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.530867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.531048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.531472 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.531648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.531873 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532025 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532167 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532314 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532758 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.532908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533056 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533353 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.533783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.534439 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.534580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.534580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.534872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.534872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.535161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.535327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.535494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.535637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.535794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.535944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536572 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536918 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.536999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537254 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537427 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537607 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537687 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537872 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.537955 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538112 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538311 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.538910 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539187 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539270 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539388 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539467 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539876 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.539969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540310 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540475 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.540919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541091 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541176 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541310 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541743 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.541920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542019 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542110 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542206 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542372 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542461 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542729 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.542987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543166 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543248 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543629 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.543976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544067 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544591 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544865 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.544956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545047 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545047 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545909 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.545979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546127 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546408 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546490 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546568 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546640 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.546995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547545 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547780 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547850 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.547919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548082 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548237 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548308 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.548797 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.549100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.549422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.549516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.549852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.550167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.550490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.550711 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.550852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.551076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.551177 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.551528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.551653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.551796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.551969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.552162 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.552302 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.552530 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.552672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.552861 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553149 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553432 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.553882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.554559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.554853 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.554992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.555172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.555330 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.555533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.555624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.555839 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.555932 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.556149 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.556242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.556461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.556561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.556771 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.556869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.557095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.557193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.557419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.557518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.557734 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.557824 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.558057 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.558149 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.558381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.558532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.558703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.558867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559377 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559755 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.559963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.560054 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.560287 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.560384 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.560609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.560797 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.560921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.561016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.561295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.561410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.561542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.561875 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.561875 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.562182 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.562336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.562487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.562636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.562792 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.562934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563087 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563406 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.563997 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.564146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.564295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.564445 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.564593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.564740 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.564890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565040 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.565907 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566351 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566492 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566632 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.566937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567079 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.567994 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.568093 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.568305 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.568444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.568624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.568775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.568932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.569033 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.569498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.569670 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.570367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.570497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.570695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.570788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.571007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.571097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.571397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.571512 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.571721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.571975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572103 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572649 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572749 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.572969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.573060 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.573281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.573410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.573594 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.573686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.573905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.574004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.574258 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.574358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.574571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.574662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.574937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.575039 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.575251 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.575369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.575599 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.575690 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.575910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576019 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576227 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576632 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576854 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.576954 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.577164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.577262 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.577474 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.577566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.577794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.577893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.578102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.578192 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.578412 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.578556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.578725 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.578838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.579055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.579154 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.579403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.579499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.579728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.579893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.580059 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.580211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.580389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.580527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.580729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.580866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.581044 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.581165 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.581363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.581492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.581683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.581840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582462 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582640 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.582961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.583053 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.583283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.583423 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.583625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.583716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.583948 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584046 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584375 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.584990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.585242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.585346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.585557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.585657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.585891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.585989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.586213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.586312 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.586526 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.586623 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.586845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.586935 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.587157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.587248 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.587501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.587595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.587815 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.587905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.588141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.588257 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.588454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.588578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.588783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.588886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.589095 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.589187 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.589412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.589512 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.589727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.589832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590145 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590355 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590448 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.590993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.591136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.591375 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.591486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.591655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.591794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.591975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.592127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.592305 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.592420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.592639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.592732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.592950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.593042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.593277 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.593383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.593595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.593697 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.593904 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.594936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.595168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.595267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.595566 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.595660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.595904 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.595996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.596222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.596360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.596540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.596638 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.596881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.596973 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.597217 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.597310 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.597539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.597639 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.597863 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.597962 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.598192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.598291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.598501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.598591 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.598807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.598900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.599125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.599218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.599461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.599604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.599774 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.599880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.600084 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.600183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.600399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.600491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.600706 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.600826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601447 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601673 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601774 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.601981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.602073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.602306 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.602451 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.602628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.602769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.602936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.603028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.603242 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.603368 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.603579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.603680 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.603949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.604979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.605205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.605332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.605535 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.605656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.605851 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.605944 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.606170 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.606272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.606489 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.606614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.606808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.606925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.607121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.607228 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.607468 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.607561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.607794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.607886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.608119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.608225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.608444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.608537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.608761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.608854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.609086 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.609185 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.609408 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.609507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.609721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.609812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.610052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.610274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.610374 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.610616 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.610715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.610945 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.611050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.611273 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.611388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.611620 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.611725 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.611943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.612050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.612266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.612390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.612595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.612688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.612918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613018 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613236 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.613987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.614210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.614307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.614537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.614630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.614870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.614962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.615180 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.615280 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.615514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.615605 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.615832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.615926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.616144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.616235 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.616970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.617085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.617290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.617411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.617611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.617715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.617920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618228 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618328 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.618991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.619172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.619264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.619519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.619620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.619837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.619929 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.620149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.620248 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.620461 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.620553 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.620776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.620880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.621092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.621191 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.621422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.621517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.621760 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.621859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.622086 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.622177 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.622409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.622558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.622730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.622866 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.623051 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.623151 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.623407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.623607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.623738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.623931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.624066 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.624270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.624397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.624600 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.624724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.624929 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.625051 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.625252 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.625376 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.625575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.625703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.625907 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.626025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.626221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.626351 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.626531 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.626677 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.626851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.627006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.627168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.627503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.627611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.627833 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.627933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.628151 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.628244 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.628461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.628554 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.628789 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.628887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.629104 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.629196 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.629467 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.629641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.629789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.629995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.630112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.630317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.630418 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.630646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.630738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.630974 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.631065 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.631314 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.631457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.631622 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.631742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.631946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.632089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.632312 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.632458 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.633118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.633230 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.633442 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.633559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.633760 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.633883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.634071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.634251 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.634380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.634574 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.634699 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.634889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635214 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635667 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.635982 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.636215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.636347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.636542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.636640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.636862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.636973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.637176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.637304 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.637495 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.637618 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.637806 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.637913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.638115 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.638231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.638425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.638530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.638733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.638838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.639060 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.639171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.639383 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.639493 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.639702 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.639794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640328 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.640985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.641209 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.641302 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.641551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.641661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.641886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.641989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.642207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.642300 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.642530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.642628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.642845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.642946 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.643178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.643279 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.643516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.643610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.643897 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.644013 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.644153 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.644246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.644473 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.644571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.644787 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.645015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.645115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.645356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.645449 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.645684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.645789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.646022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.646117 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.646345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.646443 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.646656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.646968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.647058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.647282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.647428 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.647651 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.647768 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.647975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.648076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.648293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.648392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.648609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.648716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.648926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649245 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649358 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.649965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.650189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.650283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.650506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.650609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.650822 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.650914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.651138 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.651231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.651480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.651578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.651800 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.651894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.652114 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.652215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.652434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.652528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.652749 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.652851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.653077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.653181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.653391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.653492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.653703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.653796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654148 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654338 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654646 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.654960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.655067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.655274 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.655427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.655621 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.655720 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.655931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.656037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.656306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.656397 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.656632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.656733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.656945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657366 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.657990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.658219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.658311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.658533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.658633 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.658859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.658952 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.659175 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.659307 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.659526 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.659630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.659849 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.659943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.660179 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.660279 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.660502 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.660603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.660810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.660945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.661122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.661221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.661434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.661577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.661752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.662013 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.662294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.662399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.662570 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.662694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.662879 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.663006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.663193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.663391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.663567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.663712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.663877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.664031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.664193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.664356 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.664501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.664686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.664810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665741 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.665970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.666063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.666291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.666393 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.666601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.666700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.666908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667222 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667659 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.667959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.668172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.668266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.668494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.668627 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.668788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.668909 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.669123 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.669246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.669473 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.669617 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.669771 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.669877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.670096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.670195 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.670409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.670509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.670736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.670837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.671048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.671138 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.671386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.671494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.671705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.671811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672437 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672763 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.672979 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.673079 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.673299 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.673397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.673614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.673707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.673932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674024 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.674985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.675224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.675330 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.675575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.675669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.675902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676638 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676870 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.676969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.677187 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.677295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.677521 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.677614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.677832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.677930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.678145 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.678249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.678454 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.678546 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.678766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.678865 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.679631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.679732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.679951 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680043 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680674 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.680991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.681212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.681311 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.681526 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.681620 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.681838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.681937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.682151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.682253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.682467 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.682559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.682775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.682868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.683089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.683226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.683423 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.683549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.683738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.683850 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.684000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 18:56:49.684108 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.684339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.684655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.684964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.685274 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.685582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.685893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.686201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.686542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.686885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.687211 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.687592 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.687917 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.688248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.688568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.688901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.689234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.689559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.689879 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.690222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.690545 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.690865 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.691186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.691532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.691853 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.692174 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.692509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.692842 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.693159 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.693488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.693812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.694399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.695312 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.695634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.695975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.696298 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.696620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.696947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.697267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.697588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.697915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.698241 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.698581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.698915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.699249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.699612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.699969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.700290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.700651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.700989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.701311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.701632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.701945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:56:49.702200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 18:56:49.708088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.725123 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_db.sqlalchemy.engines [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.772296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.context [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40d0ea05-af06-458f-98eb-de2bb03f4480(cell1) {{(pid=117096) load_cells /opt/stack/nova/nova/context.py:464}} May 11 18:56:49.776726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:56:49.778321 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:56:49.779129 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:56:49.781113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:56:49.790569 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.context [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40d0ea05-af06-458f-98eb-de2bb03f4480(cell1) {{(pid=117097) load_cells /opt/stack/nova/nova/context.py:464}} May 11 18:56:49.792926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.795097 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:56:49.795246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.796778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:56:49.797610 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:56:49.799694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:56:49.812909 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_db.sqlalchemy.engines [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.814243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_db.sqlalchemy.engines [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.954890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:49.974659 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_db.sqlalchemy.engines [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:56:50.280673 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: WARNING keystonemiddleware.auth_token [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:56:50.293406 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: WARNING keystonemiddleware.auth_token [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:56:50.307138 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: WARNING keystonemiddleware.auth_token [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:56:50.314691 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: WARNING keystonemiddleware.auth_token [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:56:50.644875 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: WARNING keystonemiddleware.auth_token [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:56:50.651720 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: WARNING keystonemiddleware.auth_token [None req-96b9aa1a-7895-4ac9-8abf-e5cf77daf622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:56:50.656944 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637f11fc9c0 pid: 117096 (default app) May 11 18:56:50.662752 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: WARNING keystonemiddleware.auth_token [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 18:56:50.669028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: WARNING keystonemiddleware.auth_token [None req-b2103c46-50b5-4b87-92fe-4236cda58105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 18:56:50.674396 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637f11fc9c0 pid: 117097 (default app) May 11 18:57:33.742281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-333343275", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "networks": [{"uuid": "791bcfdb-eb84-4d6a-b948-75eb93efa788"}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:33.924962 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0edbcc9b-78c4-4fea-ab58-cac679794856 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Action: 'create', calling method: .version_select at 0x7fa78d62e280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1451275277", "metadata": {"Type": "work"}}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0edbcc9b-78c4-4fea-ab58-cac679794856 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Request method failure captured: May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 122 May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcc_b_qdzvWBwRovYK-s6DMLH90AT_TCS3DaQkMPVSmjLLO9cZLBoR4X0xaMSxl6xlsfcT-L3TtRndaRKqgO9laZCX1OR0P4L2w_ADdIvRotCAcC5DpedOE5jDaluex2LuVj8oLFRe-Dl5WYzJNSU7XHOPnygt7P_9Xpryz6R7J3sU May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:57:33.951707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2823ee02ad764906b041f1ff9504a955", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesNegativeTest-200920498 May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesNegativeTest-200920498-project May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 8144879929e94220b001b5bd334629b3 May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesNegativeTest-200920498-project May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1451275277", "metadata": {"Type": "work"}}} May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:57:33.953436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1451275277', 'metadata': {'Type': 'work'}}}} May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise error May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi '#$%' May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:33.954347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 18:57:33.955981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 18:57:33.957549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 18:57:33.957549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:33.957549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0edbcc9b-78c4-4fea-ab58-cac679794856 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:33.958811 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0edbcc9b-78c4-4fea-ab58-cac679794856 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.060985 May 11 18:57:33.959593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 1/1] 10.222.0.93 () {60 vars in 1155 bytes} [Wed May 11 18:57:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1064 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 18:57:34.039678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1974d971-8ab1-4b37-9d12-bff5a13dc97d tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Action: 'create', calling method: .version_select at 0x7fa78d780d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1203168873"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:34.276625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] validate_networks() for [('791bcfdb-eb84-4d6a-b948-75eb93efa788', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:57:35.174667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1974d971-8ab1-4b37-9d12-bff5a13dc97d tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.211979 May 11 18:57:35.175404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 2/2] 10.222.0.93 () {60 vars in 1154 bytes} [Wed May 11 18:57:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1214 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 18:57:35.181632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ab57f4cb-46db-46b1-8663-a91204dca84d tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Action: 'create', calling method: .version_select at 0x7fa78d4af700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-493584336", "metadata": {"Type": "work"}}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ab57f4cb-46db-46b1-8663-a91204dca84d tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Request method failure captured: May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 119 May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcc_b_qdzvWBwRovYK-s6DMLH90AT_TCS3DaQkMPVSmjLLO9cZLBoR4X0xaMSxl6xlsfcT-L3TtRndaRKqgO9laZCX1OR0P4L2w_ADdIvRotCAcC5DpedOE5jDaluex2LuVj8oLFRe-Dl5WYzJNSU7XHOPnygt7P_9Xpryz6R7J3sU May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:57:35.190609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2823ee02ad764906b041f1ff9504a955", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 8144879929e94220b001b5bd334629b3 May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-493584336", "metadata": {"Type": "work"}}} May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:57:35.191921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-493584336', 'metadata': {'Type': 'work'}}}} May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise error May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi '0' May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:35.192657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 18:57:35.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 18:57:35.195370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 18:57:35.195370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.197109 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ab57f4cb-46db-46b1-8663-a91204dca84d tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:35.198212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ab57f4cb-46db-46b1-8663-a91204dca84d tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021364 May 11 18:57:35.200331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 3/3] 10.222.0.93 () {60 vars in 1155 bytes} [Wed May 11 18:57:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 18:57:35.212243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8fd4a275-9995-4363-a8da-12bb3a7daf6c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d43d5e0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:35.350964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8fd4a275-9995-4363-a8da-12bb3a7daf6c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 200 len: 345 microversion: 2.1 time: 0.149243 May 11 18:57:35.351855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 4/4] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:35 2022] GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:35.356834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5dc03a3a-5f74-4986-a7dd-92c47e854102 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Action: 'create', calling method: .version_select at 0x7fa78d4afdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-187651451", "metadata": {"Type": "work"}}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5dc03a3a-5f74-4986-a7dd-92c47e854102 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Request method failure captured: May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 118 May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcc_b_qdzvWBwRovYK-s6DMLH90AT_TCS3DaQkMPVSmjLLO9cZLBoR4X0xaMSxl6xlsfcT-L3TtRndaRKqgO9laZCX1OR0P4L2w_ADdIvRotCAcC5DpedOE5jDaluex2LuVj8oLFRe-Dl5WYzJNSU7XHOPnygt7P_9Xpryz6R7J3sU May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:57:35.359406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2823ee02ad764906b041f1ff9504a955", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 8144879929e94220b001b5bd334629b3 May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-187651451", "metadata": {"Type": "work"}}} May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:57:35.361049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-187651451', 'metadata': {'Type': 'work'}}}} May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise error May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi '' May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:35.362133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 18:57:35.363676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 18:57:35.367188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 18:57:35.367188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.367188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5dc03a3a-5f74-4986-a7dd-92c47e854102 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:35.380214 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5dc03a3a-5f74-4986-a7dd-92c47e854102 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026956 May 11 18:57:35.381519 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 5/5] 10.222.0.93 () {60 vars in 1155 bytes} [Wed May 11 18:57:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 18:57:35.396562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b95e839d-cffb-4861-9e0d-034972b8785e tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Calling method '.version_select at 0x7fa78d43d700>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:35.434595 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-b95e839d-cffb-4861-9e0d-034972b8785e tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] HTTP exception thrown: Volume tempest-invalid-948952887 could not be found. May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b95e839d-cffb-4861-9e0d-034972b8785e tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Request method failure captured: May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-948952887 HTTP/1.1 May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcc_b_qdzvWBwRovYK-s6DMLH90AT_TCS3DaQkMPVSmjLLO9cZLBoR4X0xaMSxl6xlsfcT-L3TtRndaRKqgO9laZCX1OR0P4L2w_ADdIvRotCAcC5DpedOE5jDaluex2LuVj8oLFRe-Dl5WYzJNSU7XHOPnygt7P_9Xpryz6R7J3sU May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:57:35.440576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2823ee02ad764906b041f1ff9504a955", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 8144879929e94220b001b5bd334629b3 May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Volume tempest-invalid-948952887 could not be found. May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'tempest-invalid-948952887'} May 11 18:57:35.441969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-948952887 could not be found. (HTTP 404) (Request-ID: req-6c2d36dc-4128-471e-a240-06cff6826424) May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.442706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 18:57:35.443920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-948952887 could not be found. May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:35.445796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-948952887 could not be found. May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-948952887 could not be found. May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b95e839d-cffb-4861-9e0d-034972b8785e tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Returning 404 to user: Volume tempest-invalid-948952887 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b95e839d-cffb-4861-9e0d-034972b8785e tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-948952887" status: 404 len: 98 microversion: 2.1 time: 0.055552 May 11 18:57:35.447010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 6/6] 10.222.0.93 () {58 vars in 1214 bytes} [Wed May 11 18:57:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-948952887 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 11 18:57:35.456724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5a98443e-b51a-4c29-8f7a-120d7b98e6d6 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006904 May 11 18:57:35.457637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 7/7] 10.222.0.93 () {58 vars in 1139 bytes} [Wed May 11 18:57:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 18:57:35.471055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2dd52417-6e1b-47c6-b7a1-394f37b9652c tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004276 May 11 18:57:35.472446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 8/8] 10.222.0.93 () {58 vars in 1136 bytes} [Wed May 11 18:57:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 11 18:57:35.484490 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5d30e39b-3ece-40d7-ba1f-399409e2e851 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Calling method '.version_select at 0x7fa78d4173a0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:35.530226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-5d30e39b-3ece-40d7-ba1f-399409e2e851 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] HTTP exception thrown: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5d30e39b-3ece-40d7-ba1f-399409e2e851 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Request method failure captured: May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/os-volumes/83e5a61f-9e5b-4855-87db-b68c86b006bf HTTP/1.1 May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcc_b_qdzvWBwRovYK-s6DMLH90AT_TCS3DaQkMPVSmjLLO9cZLBoR4X0xaMSxl6xlsfcT-L3TtRndaRKqgO9laZCX1OR0P4L2w_ADdIvRotCAcC5DpedOE5jDaluex2LuVj8oLFRe-Dl5WYzJNSU7XHOPnygt7P_9Xpryz6R7J3sU May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:57:35.532978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2823ee02ad764906b041f1ff9504a955", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 8144879929e94220b001b5bd334629b3 May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '83e5a61f-9e5b-4855-87db-b68c86b006bf'} May 11 18:57:35.534528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. (HTTP 404) (Request-ID: req-7ded5834-5104-4150-b581-1474228cfe7d) May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.535442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 18:57:35.536580 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 18:57:35.538818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5d30e39b-3ece-40d7-ba1f-399409e2e851 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Returning 404 to user: Volume 83e5a61f-9e5b-4855-87db-b68c86b006bf could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:35.541249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5d30e39b-3ece-40d7-ba1f-399409e2e851 tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/83e5a61f-9e5b-4855-87db-b68c86b006bf" status: 404 len: 109 microversion: 2.1 time: 0.061571 May 11 18:57:35.548031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 9/9] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 18:57:35 2022] DELETE /compute/v2.1/os-volumes/83e5a61f-9e5b-4855-87db-b68c86b006bf => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 18:57:35.552406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b4e2600a-ea15-4add-b8c1-6b0ab99ac8ae tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Calling method '.version_select at 0x7fa78d43d9d0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:35.607019 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-b4e2600a-ea15-4add-b8c1-6b0ab99ac8ae tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] HTTP exception thrown: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b4e2600a-ea15-4add-b8c1-6b0ab99ac8ae tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Request method failure captured: May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/os-volumes/bf11dd14-ebef-4ae9-a49c-361274754e82 HTTP/1.1 May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcc_b_qdzvWBwRovYK-s6DMLH90AT_TCS3DaQkMPVSmjLLO9cZLBoR4X0xaMSxl6xlsfcT-L3TtRndaRKqgO9laZCX1OR0P4L2w_ADdIvRotCAcC5DpedOE5jDaluex2LuVj8oLFRe-Dl5WYzJNSU7XHOPnygt7P_9Xpryz6R7J3sU May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:57:35.609194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2823ee02ad764906b041f1ff9504a955", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2823ee02ad764906b041f1ff9504a955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2823ee02ad764906b041f1ff9504a955 May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesNegativeTest-200920498 May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 8144879929e94220b001b5bd334629b3 May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesNegativeTest-200920498-project May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'bf11dd14-ebef-4ae9-a49c-361274754e82'} May 11 18:57:35.610457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. (HTTP 404) (Request-ID: req-4c9f23d2-d6ca-4476-bd88-08da67eee668) May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.611200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:35.612329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 18:57:35.614098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b4e2600a-ea15-4add-b8c1-6b0ab99ac8ae tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] Returning 404 to user: Volume bf11dd14-ebef-4ae9-a49c-361274754e82 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b4e2600a-ea15-4add-b8c1-6b0ab99ac8ae tempest-VolumesNegativeTest-200920498 tempest-VolumesNegativeTest-200920498-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/bf11dd14-ebef-4ae9-a49c-361274754e82" status: 404 len: 109 microversion: 2.1 time: 0.064121 May 11 18:57:35.615156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 10/10] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:35 2022] GET /compute/v2.1/os-volumes/bf11dd14-ebef-4ae9-a49c-361274754e82 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:57:35.793460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:57:35.794094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:57:35.794579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:57:35.795332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:57:35.795852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:57:35.821811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:35.825135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:35.829039 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:35.830424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:35.912039 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Getting quotas for project 2fbf31f703e849cfa03c63580dee547a. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:57:35.921247 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Getting quotas for user 29349dabed5746449cefe237fd3739c3 and project 2fbf31f703e849cfa03c63580dee547a. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:57:35.949250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:57:35.952784 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:57:36.121002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4ad730ba-8e0b-4337-941d-e7958d3c51e1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.659598 May 11 18:57:36.121669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 1/11] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:57:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:57:36.132340 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5593bee4-6d48-4945-a889-1c9e11eeb763 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:36.133244 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5593bee4-6d48-4945-a889-1c9e11eeb763 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:36.364094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b0f0847d-3cbd-48af-b4d1-d31070220f1d tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78cc2f280>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:36.472628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b0f0847d-3cbd-48af-b4d1-d31070220f1d tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 200 len: 346 microversion: 2.1 time: 0.112800 May 11 18:57:36.474837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5593bee4-6d48-4945-a889-1c9e11eeb763 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:36.481937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 2/12] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:36 2022] GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:57:36.487260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bd0fcea9-8d02-424c-b820-0eb242e3756c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Action: 'create', calling method: .version_select at 0x7fa78c391b80>, body: {"snapshot": {"volume_id": "f04821b1-5bdf-484c-8371-c8f1cf4d2cb8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-549287493"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:36.506787 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5593bee4-6d48-4945-a889-1c9e11eeb763 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1214 microversion: 2.1 time: 0.377276 May 11 18:57:36.509551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 11/13] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:36 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:36.869257 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bd0fcea9-8d02-424c-b820-0eb242e3756c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.385522 May 11 18:57:36.870548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 3/14] 10.222.0.93 () {60 vars in 1161 bytes} [Wed May 11 18:57:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:36.881507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6e76a91b-f7ec-4911-938d-701df005889b tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d41d670>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:36.936566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6e76a91b-f7ec-4911-938d-701df005889b tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 286 microversion: 2.1 time: 0.059556 May 11 18:57:36.937247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 12/15] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:36 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:57:36.947735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-94c66727-fd0b-4cc6-9fb7-85f4bafbff22 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78de57790>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:37.045332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fe747be6-5ff1-43a4-bd9c-e3064ef9b517 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78d3dac10>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:37.058770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-94c66727-fd0b-4cc6-9fb7-85f4bafbff22 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.115690 May 11 18:57:37.059612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 4/16] 10.222.0.93 () {58 vars in 1139 bytes} [Wed May 11 18:57:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:37.070153 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f9f4bfd6-cbd4-41f6-b0cc-47c1d578d44b tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c39e700>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:37.118841 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f9f4bfd6-cbd4-41f6-b0cc-47c1d578d44b tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 286 microversion: 2.1 time: 0.052906 May 11 18:57:37.120722 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 5/17] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:37 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:37.138593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fe747be6-5ff1-43a4-bd9c-e3064ef9b517 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/597e873d-811d-430a-b501-c01f4676c1fd" status: 200 len: 350 microversion: 2.1 time: 0.097103 May 11 18:57:37.152679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 13/18] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:37 2022] GET /compute/v2.1/os-volumes/597e873d-811d-430a-b501-c01f4676c1fd => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:37.526679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ad3818ca-8afe-4569-a9a4-2c3d030b27da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:37.527608 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ad3818ca-8afe-4569-a9a4-2c3d030b27da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:37.756752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ad3818ca-8afe-4569-a9a4-2c3d030b27da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:37.784392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ad3818ca-8afe-4569-a9a4-2c3d030b27da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1214 microversion: 2.1 time: 0.262897 May 11 18:57:37.785828 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 6/19] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:37 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:38.131484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fd2b4cdb-a5b1-4402-bead-1a8db047c69c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d3ea3a0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:38.201339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fd2b4cdb-a5b1-4402-bead-1a8db047c69c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 286 microversion: 2.1 time: 0.075065 May 11 18:57:38.202779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 14/20] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:38 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:38.803093 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:38.803749 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:38.812657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:38.814843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:38.815860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:38.822270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:39.162788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:39.189032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-31f6d72d-0b76-4254-9782-99520f900838 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1218 microversion: 2.1 time: 0.389975 May 11 18:57:39.195803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 7/21] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:38 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1218 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:39.213922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4447523d-0b5c-4c1b-8641-25eb74f6c8d0 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d3da700>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:39.260382 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4447523d-0b5c-4c1b-8641-25eb74f6c8d0 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 286 microversion: 2.1 time: 0.050708 May 11 18:57:39.265226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 15/22] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:39 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:40.211946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:40.213174 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:40.227499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:40.228262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:40.229278 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:40.229902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:40.272695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c98b6c73-cf5c-45ed-ad28-dbe0e7b86067 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d417940>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:40.341501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c98b6c73-cf5c-45ed-ad28-dbe0e7b86067 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 286 microversion: 2.1 time: 0.072741 May 11 18:57:40.343553 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 16/23] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:40 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:40.678930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:40.702226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5e9d2623-1b43-454c-8d6f-26f0bdcead52 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1218 microversion: 2.1 time: 0.496284 May 11 18:57:40.709400 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 8/24] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:40 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1218 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:41.147150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-68e10b5e-0162-426e-a23f-7b69c5ffd8dd tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78d3ea550>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:41.359329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8bc31e0d-90e8-4b83-8579-0ebb9fe57fc7 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c2c6670>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:41.368217 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-68e10b5e-0162-426e-a23f-7b69c5ffd8dd tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/be43f6af-4754-44a5-b35e-dba426a15b25" status: 200 len: 351 microversion: 2.1 time: 0.235351 May 11 18:57:41.369440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 17/25] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:41 2022] GET /compute/v2.1/os-volumes/be43f6af-4754-44a5-b35e-dba426a15b25 => generated 351 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:41.523007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8bc31e0d-90e8-4b83-8579-0ebb9fe57fc7 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 287 microversion: 2.1 time: 0.172094 May 11 18:57:41.524032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 9/26] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:41 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:41.533757 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fb9ff3e4-944b-4de6-b9cc-b16f3bc085f5 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d3eaaf0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:41.700030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fb9ff3e4-944b-4de6-b9cc-b16f3bc085f5 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 202 len: 0 microversion: 2.1 time: 0.170065 May 11 18:57:41.703436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 18/27] 10.222.0.93 () {58 vars in 1253 bytes} [Wed May 11 18:57:41 2022] DELETE /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 18:57:41.709711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-327ebd03-790f-4837-9003-8a4c4011da4a tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c2c6430>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:41.725564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:41.726523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:41.756954 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:41.757612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:41.758545 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:41.759756 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:41.778610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-327ebd03-790f-4837-9003-8a4c4011da4a tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 200 len: 286 microversion: 2.1 time: 0.073407 May 11 18:57:41.779456 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 10/28] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:41 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:42.792194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-30d2a9c8-3bbd-4bfc-a626-f0d69e408409 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c3368b0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:42.879864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-30d2a9c8-3bbd-4bfc-a626-f0d69e408409 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] HTTP exception thrown: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-30d2a9c8-3bbd-4bfc-a626-f0d69e408409 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Request method failure captured: May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a HTTP/1.1 May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcd_w2_J8L98AnetY3gJgDBQEjRbp80pTzTDCVCseAAruUgc2gg6y_tE7BOpbxyOw8YnTrsIZCfECKfl8xR2Tndfy8UHwuRdBBeo-Ko-73IgXjV7_CUWYZo3mUqTakdZ7tLK4FNrUuKGoI2ftHB0LAFOltBQCfeGi30TrlHNU9sLcE May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 18:57:42.887042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bc1e0447fab4adcafaf48de56af2eea", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 9e32dc69c3114cd7960308b1d7fd3c86 May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'a209728f-1a10-4f48-9655-62ed1f88e92a'} May 11 18:57:42.888352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. (HTTP 404) (Request-ID: req-c6f82851-4250-42f8-9918-61e7f4c26435) May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.889004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:42.889849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 11 18:57:42.890666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-30d2a9c8-3bbd-4bfc-a626-f0d69e408409 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Returning 404 to user: Snapshot a209728f-1a10-4f48-9655-62ed1f88e92a could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-30d2a9c8-3bbd-4bfc-a626-f0d69e408409 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a" status: 404 len: 111 microversion: 2.1 time: 0.102014 May 11 18:57:42.891563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 11/29] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 18:57:42 2022] GET /compute/v2.1/os-snapshots/a209728f-1a10-4f48-9655-62ed1f88e92a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 18:57:42.907732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-27b459d0-ffa0-4447-ac6a-82eac7bd642b tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c336ee0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:42.992256 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:43.011837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0c1c696d-f3e0-423d-b376-52492f217006 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1274 microversion: 2.1 time: 1.289967 May 11 18:57:43.020152 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 19/30] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:41 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1274 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:57:43.061066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-27b459d0-ffa0-4447-ac6a-82eac7bd642b tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 202 len: 0 microversion: 2.1 time: 0.163107 May 11 18:57:43.062060 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 12/31] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 18:57:42 2022] DELETE /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 18:57:43.070871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d9056b89-8b24-40fe-84ca-b3e181baf006 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78d3dadc0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:43.193749 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d9056b89-8b24-40fe-84ca-b3e181baf006 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 200 len: 345 microversion: 2.1 time: 0.127045 May 11 18:57:43.194847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 20/32] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:43 2022] GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:43.585216 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b0f8bae4-dbef-45db-8728-0eef2dbec7df tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78c2d38b0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:43.710554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b0f8bae4-dbef-45db-8728-0eef2dbec7df tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/b208240f-2e15-4aa5-9802-9e4b845dd809" status: 200 len: 350 microversion: 2.1 time: 0.130701 May 11 18:57:43.711897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 13/33] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:43 2022] GET /compute/v2.1/os-volumes/b208240f-2e15-4aa5-9802-9e4b845dd809 => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:43.723979 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dbe3da5c-d8a3-4290-81e8-f288b6bdb2ad tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78d35f160>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:43.960821 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-dbe3da5c-d8a3-4290-81e8-f288b6bdb2ad tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.240538 May 11 18:57:43.961378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 21/34] 10.222.0.93 () {58 vars in 1133 bytes} [Wed May 11 18:57:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:43.975646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-00582a01-52bc-47de-be3f-87b09cb594c5 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78c2d3a60>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:44.033554 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:44.034163 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:44.056883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:44.057343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:44.058127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:44.058568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:44.202008 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-00582a01-52bc-47de-be3f-87b09cb594c5 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.230816 May 11 18:57:44.209648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 14/35] 10.222.0.93 () {58 vars in 1148 bytes} [Wed May 11 18:57:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:44.214694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2045625a-567d-4c97-945a-6fe5e724d731 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c39e1f0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:44.262238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-2045625a-567d-4c97-945a-6fe5e724d731 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] HTTP exception thrown: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2045625a-567d-4c97-945a-6fe5e724d731 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Request method failure captured: May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 HTTP/1.1 May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcd_w2_J8L98AnetY3gJgDBQEjRbp80pTzTDCVCseAAruUgc2gg6y_tE7BOpbxyOw8YnTrsIZCfECKfl8xR2Tndfy8UHwuRdBBeo-Ko-73IgXjV7_CUWYZo3mUqTakdZ7tLK4FNrUuKGoI2ftHB0LAFOltBQCfeGi30TrlHNU9sLcE May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 18:57:44.283901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bc1e0447fab4adcafaf48de56af2eea", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 9e32dc69c3114cd7960308b1d7fd3c86 May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'f04821b1-5bdf-484c-8371-c8f1cf4d2cb8'} May 11 18:57:44.285196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. (HTTP 404) (Request-ID: req-68b99a95-34a9-4af9-97db-37ad39b9b903) May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:44.286054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:44.287207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 18:57:44.288172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.289497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.312783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2045625a-567d-4c97-945a-6fe5e724d731 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Returning 404 to user: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:44.313694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2045625a-567d-4c97-945a-6fe5e724d731 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 404 len: 109 microversion: 2.1 time: 0.102771 May 11 18:57:44.314272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 15/36] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:44 2022] GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:57:44.337199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-58197902-9163-4086-9723-7c0df617a19a tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78c2f6a60>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:44.585139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-58197902-9163-4086-9723-7c0df617a19a tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.264884 May 11 18:57:44.592662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 16/37] 10.222.0.93 () {58 vars in 1133 bytes} [Wed May 11 18:57:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:44.592662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3a72883d-d543-4a44-bec5-4af630803671 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c2d3700>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:44.683755 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-3a72883d-d543-4a44-bec5-4af630803671 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] HTTP exception thrown: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3a72883d-d543-4a44-bec5-4af630803671 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Request method failure captured: May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 HTTP/1.1 May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcd_w2_J8L98AnetY3gJgDBQEjRbp80pTzTDCVCseAAruUgc2gg6y_tE7BOpbxyOw8YnTrsIZCfECKfl8xR2Tndfy8UHwuRdBBeo-Ko-73IgXjV7_CUWYZo3mUqTakdZ7tLK4FNrUuKGoI2ftHB0LAFOltBQCfeGi30TrlHNU9sLcE May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 18:57:44.686067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bc1e0447fab4adcafaf48de56af2eea", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 9e32dc69c3114cd7960308b1d7fd3c86 May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'f04821b1-5bdf-484c-8371-c8f1cf4d2cb8'} May 11 18:57:44.687490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. (HTTP 404) (Request-ID: req-ccd1c4d3-2e9c-42de-b996-713e4e302aaf) May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:44.691627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 18:57:44.693090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 18:57:44.694698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3a72883d-d543-4a44-bec5-4af630803671 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Returning 404 to user: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3a72883d-d543-4a44-bec5-4af630803671 tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 404 len: 109 microversion: 2.1 time: 0.100144 May 11 18:57:44.696519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 17/38] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 18:57:44 2022] DELETE /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:57:44.897534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-16828e11-c77c-422a-882c-ffbc43197391 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'create', calling method: .version_select at 0x7fa78c28c790>, body: {"keypair": {"name": "tempest-keypair-1622915487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEnDysi7X2E4xXeSQQDCIfVS2fEvBrpV4AH0GF0C2NVo3xm9aHoVTiYJ/HvBh2eKtR5vQoh1VM4D6CyON0Dk3+b8idiukJxHTQ1UymavNXn7pD5oSo6I5cm8Aox5iY+cw=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:44.956536 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-16828e11-c77c-422a-882c-ffbc43197391 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:57:44.964924 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-16828e11-c77c-422a-882c-ffbc43197391 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for user 378aab35909343d88c0250493e41be34 and project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:57:44.983709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:44.999876 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ce5300a7-4dc7-4f54-a054-a4a71372b06d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1272 microversion: 2.1 time: 0.969332 May 11 18:57:45.001484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 22/39] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:44 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1272 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:57:45.020678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ab0dc31e-532c-4a42-8b5c-e8055f9466ce tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78d35f790>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:45.061493 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-16828e11-c77c-422a-882c-ffbc43197391 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.371813 May 11 18:57:45.062551 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 18/40] 10.222.0.93 () {62 vars in 1199 bytes} [Wed May 11 18:57:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 18:57:45.073930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a61b8233-a0aa-4564-8bf4-5d69d43c6e5c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Calling method '.version_select at 0x7fa78c28cca0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:45.112535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-a61b8233-a0aa-4564-8bf4-5d69d43c6e5c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] HTTP exception thrown: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a61b8233-a0aa-4564-8bf4-5d69d43c6e5c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Request method failure captured: May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 HTTP/1.1 May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcd_w2_J8L98AnetY3gJgDBQEjRbp80pTzTDCVCseAAruUgc2gg6y_tE7BOpbxyOw8YnTrsIZCfECKfl8xR2Tndfy8UHwuRdBBeo-Ko-73IgXjV7_CUWYZo3mUqTakdZ7tLK4FNrUuKGoI2ftHB0LAFOltBQCfeGi30TrlHNU9sLcE May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 18:57:45.114916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bc1e0447fab4adcafaf48de56af2eea", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bc1e0447fab4adcafaf48de56af2eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 5bc1e0447fab4adcafaf48de56af2eea May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-136423367 May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 9e32dc69c3114cd7960308b1d7fd3c86 May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-VolumesSnapshotsTestJSON-136423367-project May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'f04821b1-5bdf-484c-8371-c8f1cf4d2cb8'} May 11 18:57:45.116584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. (HTTP 404) (Request-ID: req-2489c6b0-159a-4c6a-a433-e5af22d88fd6) May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:45.117275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:57:45.118556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 18:57:45.120736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. May 11 18:57:45.122975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:57:45.124708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a61b8233-a0aa-4564-8bf4-5d69d43c6e5c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] Returning 404 to user: Volume f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:57:45.125592 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a61b8233-a0aa-4564-8bf4-5d69d43c6e5c tempest-VolumesSnapshotsTestJSON-136423367 tempest-VolumesSnapshotsTestJSON-136423367-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8" status: 404 len: 109 microversion: 2.1 time: 0.061955 May 11 18:57:45.126327 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 19/41] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:57:45 2022] GET /compute/v2.1/os-volumes/f04821b1-5bdf-484c-8371-c8f1cf4d2cb8 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:57:45.199187 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ab0dc31e-532c-4a42-8b5c-e8055f9466ce tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.192506 May 11 18:57:45.200333 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 23/42] 10.222.0.93 () {58 vars in 1166 bytes} [Wed May 11 18:57:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:45.213441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-649fca99-2145-4356-8f13-f2696f52aa69 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78c2128b0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:45.443835 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-649fca99-2145-4356-8f13-f2696f52aa69 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.235294 May 11 18:57:45.445300 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 20/43] 10.222.0.93 () {58 vars in 1169 bytes} [Wed May 11 18:57:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:45.460053 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bf14cce2-7719-4cde-a8e2-40daf8733e0f tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78d3da700>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:45.607207 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bf14cce2-7719-4cde-a8e2-40daf8733e0f tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.152995 May 11 18:57:45.608702 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 24/44] 10.222.0.93 () {58 vars in 1154 bytes} [Wed May 11 18:57:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:57:45.620175 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4e6bb314-5410-46d5-a883-135d35bfad9d tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78c2120d0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:45.766100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4e6bb314-5410-46d5-a883-135d35bfad9d tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.149956 May 11 18:57:45.766680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 21/45] 10.222.0.93 () {58 vars in 1187 bytes} [Wed May 11 18:57:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:45.782750 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-31697241-3a2f-450b-a6e1-d9eaac6c4723 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] Calling method '.version_select at 0x7fa78d32aa60>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:46.016471 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-31697241-3a2f-450b-a6e1-d9eaac6c4723 tempest-VolumesTestJSON-1003431556 tempest-VolumesTestJSON-1003431556-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.239546 May 11 18:57:46.017522 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 25/46] 10.222.0.93 () {58 vars in 1154 bytes} [Wed May 11 18:57:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:46.024690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:46.024690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:46.042022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:46.042621 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:46.046003 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:46.046936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:47.341585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:47.363652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4af99c9f-8ea5-4696-b7a4-60ac8efe8e84 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 1.334397 May 11 18:57:47.366113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 22/47] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:46 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:57:48.384115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:48.384737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:48.393016 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:48.393468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:48.402688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:48.403151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:49.041145 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1510921705", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:49.156477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] validate_networks() for [('fd3e1807-14a6-4444-9e3f-94c5a4601ebb', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:57:50.033894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:50.049727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e723aedd-b046-438c-bec7-ceeb9573e31e tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 1.666004 May 11 18:57:50.063595 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 26/48] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:48 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:51.072929 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:51.073870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:51.096029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:51.103276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:51.104755 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:51.106081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:51.802293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:57:51.803523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:57:51.804294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:57:51.804881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:57:51.805410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:57:51.833606 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:51.834268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:51.836385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:51.838102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:51.912081 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:57:51.923402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for user c9d83909ea2943f5834778a2a9aa1485 and project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:57:51.953005 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:57:51.957076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:57:52.120159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-21c59033-7b30-4521-825b-ec3dedddd54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.436636 May 11 18:57:52.122392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 23/49] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:57:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 3441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:57:52.132581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:52.142206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cd46f3c5-2007-438a-93d4-9f8714c1d899 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 1.075857 May 11 18:57:52.142513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-144ae6e2-b6f5-418c-83ea-ffa62e56026d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:52.143491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-144ae6e2-b6f5-418c-83ea-ffa62e56026d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:52.146658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 27/50] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:51 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:57:52.231442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-579230152", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c9ab2fe-9057-4e17-9b0a-c8025b25ad2a"}], "security_groups": [{"name": "tempest-securitygroup--1442532311"}], "key_name": "tempest-keypair-1622915487", "user_data": "}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:52.547666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-144ae6e2-b6f5-418c-83ea-ffa62e56026d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:52.570025 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-144ae6e2-b6f5-418c-83ea-ffa62e56026d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1222 microversion: 2.1 time: 0.434599 May 11 18:57:52.574155 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 24/51] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:52 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1222 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:52.767400 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1745492328", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:52.989307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] validate_networks() for [('fd3e1807-14a6-4444-9e3f-94c5a4601ebb', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:57:53.734230 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] validate_networks() for [('5c9ab2fe-9057-4e17-9b0a-c8025b25ad2a', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:57:55.860470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:57:55.862781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:57:55.863514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:57:55.864121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:57:55.865453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:57:55.893173 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:55.897955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:55.905888 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:55.907358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:56.006846 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:57:56.027317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for user c9d83909ea2943f5834778a2a9aa1485 and project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:57:56.076607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:57:56.089669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:57:56.262849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b9349d58-1507-4746-a7cc-803f77a550eb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.510144 May 11 18:57:56.278000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 25/52] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:57:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:57:56.290684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:56.291327 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:56.327967 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:56.328439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:56.329259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:56.329718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:57.614669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:57.622607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-387bd9da-7ccd-4dbd-9b60-449b5687062c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 1.343413 May 11 18:57:57.629643 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 26/53] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:56 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:58.162959 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-1b2886ab-85ae-4a9a-94d8-ab2eb737c4ca req-87a64d56-a9b0-4518-b134-7ad85ddc93cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c97b0e6-b48c-4d3a-8a1d-46f124ac2316", "tag": "9b9f56a8-cd55-4727-86cb-d96b8e75c6d8"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:57:58.210660 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-1b2886ab-85ae-4a9a-94d8-ab2eb737c4ca req-87a64d56-a9b0-4518-b134-7ad85ddc93cb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.211824 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-1b2886ab-85ae-4a9a-94d8-ab2eb737c4ca req-87a64d56-a9b0-4518-b134-7ad85ddc93cb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.311939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-1b2886ab-85ae-4a9a-94d8-ab2eb737c4ca req-87a64d56-a9b0-4518-b134-7ad85ddc93cb service nova] Creating event network-changed:9b9f56a8-cd55-4727-86cb-d96b8e75c6d8 for instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 on hv-cinder-75510 May 11 18:57:58.312728 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-1b2886ab-85ae-4a9a-94d8-ab2eb737c4ca req-87a64d56-a9b0-4518-b134-7ad85ddc93cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117096) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 18:57:58.314182 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.315124 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.317399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.322907 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.348867 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.compute.rpcapi [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 18:57:58.349819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117096) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 18:57:58.384665 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-421f0bbb-0068-49d2-bd93-ef4670c42ec9 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.751705 May 11 18:57:58.385925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 27/54] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:57:58.392794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:58.395780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:58.410127 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.413258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.414290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.415248 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.508883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:57:58.509507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:57:58.510349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:57:58.510963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:57:58.511694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:57:58.579401 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.582297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.583929 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.585722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.608413 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:58.621840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1cd5e822-9d6a-4bac-bf24-07f4d9eace09 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1274 microversion: 2.1 time: 0.232233 May 11 18:57:58.631385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 28/55] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:58 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:58.649584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:58.650772 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:58.663758 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:57:58.673940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.675657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.679490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:58.680940 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for user 378aab35909343d88c0250493e41be34 and project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:57:58.691818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:58.715587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:57:58.718468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:57:58.957951 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-25147a39-1aa6-4d39-a78c-952ca629741d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.731780 May 11 18:57:58.958711 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 28/56] 10.222.0.93 () {62 vars in 1187 bytes} [Wed May 11 18:57:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 6733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 11 18:57:58.974668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-facf60fd-90ce-4b89-825c-77572faa4469 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:58.976318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-facf60fd-90ce-4b89-825c-77572faa4469 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:59.314969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-facf60fd-90ce-4b89-825c-77572faa4469 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:59.325053 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-facf60fd-90ce-4b89-825c-77572faa4469 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:59.326530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-facf60fd-90ce-4b89-825c-77572faa4469 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:59.327695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-facf60fd-90ce-4b89-825c-77572faa4469 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1281 microversion: 2.20 time: 0.360844 May 11 18:57:59.328265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 29/57] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:57:58 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1281 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:57:59.386286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:59.405094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0afbd613-c228-4586-af8d-4e336080d7be tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 0.760210 May 11 18:57:59.405992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 29/58] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:58 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:57:59.641083 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:57:59.641706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:57:59.657786 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:59.658256 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:59.659054 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:57:59.661444 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:57:59.816109 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:57:59.826596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f26947f5-5478-44de-aeb1-c5afb7f94609 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1282 microversion: 2.1 time: 0.189351 May 11 18:57:59.828435 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 30/59] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:57:59 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:00.346077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:00.346695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:00.367324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:00.367792 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:00.373575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:00.386110 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:00.881949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0f6a7ff6-b16d-40e3-bf3f-bd220ad7fe3b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: .version_select at 0x7fa78c231f70>, body: {"keypair": {"name": "tempest-keypair-905375014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMkRfBLCOHCwqh0sa1lPdukCSSgVIA849CC5VbIznTBdzxIggzakBHIW0oCA5MkMuegxP6txglG0DN2I4vDNK21RoSsaO5JvG0jUgRFuANimt1UAEBaGUBZJOX03qtisg=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:00.926263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-0f6a7ff6-b16d-40e3-bf3f-bd220ad7fe3b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for project 35ad10e77d194397ba6a84cf39758839. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:58:00.936404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:00.945848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:00.955894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:00.957696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-0f6a7ff6-b16d-40e3-bf3f-bd220ad7fe3b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for user f8edf1e5f81c4e81b346c82cb48a47f6 and project 35ad10e77d194397ba6a84cf39758839. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:58:00.964627 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-60e90208-02a5-44f5-8299-bfb271139cf3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1285 microversion: 2.20 time: 0.622380 May 11 18:58:00.966516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 31/60] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:00 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1285 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:00.974687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:01.000517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:01.028561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:01.029146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:01.038993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:01.039807 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:01.068020 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0f6a7ff6-b16d-40e3-bf3f-bd220ad7fe3b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.097661 May 11 18:58:01.068767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 30/61] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 18:57:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:01.092738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:01.117576 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:01.133409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:01.140254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:01.141944 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:01.142598 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:01.819095 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:01.829014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-60e9d19d-481d-4a5e-a193-72cb69b286d1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1280 microversion: 2.1 time: 0.744134 May 11 18:58:01.831532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 31/62] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:01 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1280 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:01.915628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ae01578f-4b84-4317-a165-09240d4fe352 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: .version_select at 0x7fa78c2311f0>, body: {"keypair": {"name": "tempest-keypair-1983102623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyeyAJEuKoxgqU6FABA8gnj4rVeeqdUucgMd0g3oQhCEz7p/6edHQsE4zBwxDfG9Q6TkFTEpmY8Aev1K7jG0eYizfVvje3bZn1eZjf80+1HGn+jlT197vsix65fEo1GPg=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:01.959787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-ae01578f-4b84-4317-a165-09240d4fe352 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:58:01.968072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-ae01578f-4b84-4317-a165-09240d4fe352 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:58:02.067518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ae01578f-4b84-4317-a165-09240d4fe352 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.228631 May 11 18:58:02.068572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 32/63] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 18:58:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:02.099748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:02.101117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:02.157579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:02.158551 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:02.159781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:02.160462 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:02.349796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:02.358276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d24c052c-e7bf-4f43-b7ca-fb06631fb395 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 1.390423 May 11 18:58:02.363835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 32/64] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:00 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:02.803097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:02.813623 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:02.849645 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:02.850600 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:02.856965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:02.858586 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:02.859065 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:02.860563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a54d4837-9e6a-4f3e-82c0-993abff37e33 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1339 microversion: 2.20 time: 0.790022 May 11 18:58:02.865346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 33/65] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:02 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1339 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:02.871793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:02.872275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:03.187887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:03.204963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b9b77687-18f9-46f1-b10e-7f3f9a7ac634 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1280 microversion: 2.1 time: 0.352578 May 11 18:58:03.205653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 33/66] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:02 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:03.379034 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:03.379855 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:03.406443 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:03.422971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:03.424180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:03.426090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:03.886943 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:03.887641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:03.912709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:03.915620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:03.916475 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:03.916947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:04.283068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:04.284075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:04.292266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:04.297887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-007e60d7-e684-40af-8c4d-d44b925ce5ad tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 0.925538 May 11 18:58:04.302756 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:04.304261 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-520d3e54-f593-4521-84ee-4562372eb960 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1339 microversion: 2.20 time: 0.425108 May 11 18:58:04.305438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 34/67] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:03 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1339 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:58:04.310570 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 34/68] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:03 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:04.319581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:04.320244 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:04.338178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:04.339985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:04.340967 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:04.344134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:04.504845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:04.517080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-630c848a-e0cb-4b4d-8202-11c8e2de1621 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1280 microversion: 2.1 time: 0.207465 May 11 18:58:04.520943 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 35/69] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:04 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:05.315902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:05.316584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:05.323977 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:05.324681 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:05.341423 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:05.341887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:05.342674 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:05.348057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:05.354064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:05.358863 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:05.361939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:05.362486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:06.159855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:06.173209 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:06.175148 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:06.176540 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3486df67-1ef4-4787-81f2-0403639f63ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1407 microversion: 2.20 time: 0.858000 May 11 18:58:06.178210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 36/70] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:05 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1407 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:06.183466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:06.184546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:06.191731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:06.192389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:06.193535 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:06.194564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:06.735413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:06.744941 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-89c844a2-b1af-4157-9816-42a9cd522a8a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.565439 May 11 18:58:06.748031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 37/71] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:06 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:07.022501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-f9465997-dd81-4222-870b-cf3f83db71e6 req-33c39b63-55d1-4e1c-bfb1-8473ce5437df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c97b0e6-b48c-4d3a-8a1d-46f124ac2316", "name": "network-vif-plugged", "status": "completed", "tag": "9b9f56a8-cd55-4727-86cb-d96b8e75c6d8"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:07.036322 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-f9465997-dd81-4222-870b-cf3f83db71e6 req-33c39b63-55d1-4e1c-bfb1-8473ce5437df service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.037000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-f9465997-dd81-4222-870b-cf3f83db71e6 req-33c39b63-55d1-4e1c-bfb1-8473ce5437df service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.075421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-f9465997-dd81-4222-870b-cf3f83db71e6 req-33c39b63-55d1-4e1c-bfb1-8473ce5437df service nova] Creating event network-vif-plugged:9b9f56a8-cd55-4727-86cb-d96b8e75c6d8 for instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 on hv-cinder-75510 May 11 18:58:07.076401 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-f9465997-dd81-4222-870b-cf3f83db71e6 req-33c39b63-55d1-4e1c-bfb1-8473ce5437df service nova] Acquired lock "compute-rpcapi-router" {{(pid=117097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 18:58:07.078348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.079013 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.080366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.081135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.092786 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.compute.rpcapi [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 18:58:07.095468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] Releasing lock "compute-rpcapi-router" {{(pid=117097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 18:58:07.133073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0084fa0e-44d4-45b4-83e1-8c007f6c1260 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383025 May 11 18:58:07.133998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 38/72] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:07.226696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-093cf2a2-f75e-4734-b4e1-44e1d60e5a23 req-cb975ed2-95dd-4b3d-9cb2-20198b852d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57bf0b3-ec26-4008-9534-60b21519c99c", "tag": "6b468130-64ed-447f-acd8-06ef735243a3"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:07.237716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-093cf2a2-f75e-4734-b4e1-44e1d60e5a23 req-cb975ed2-95dd-4b3d-9cb2-20198b852d46 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.238665 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-093cf2a2-f75e-4734-b4e1-44e1d60e5a23 req-cb975ed2-95dd-4b3d-9cb2-20198b852d46 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.268188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-093cf2a2-f75e-4734-b4e1-44e1d60e5a23 req-cb975ed2-95dd-4b3d-9cb2-20198b852d46 service nova] Creating event network-changed:6b468130-64ed-447f-acd8-06ef735243a3 for instance b57bf0b3-ec26-4008-9534-60b21519c99c on hv-cinder-75510 May 11 18:58:07.302972 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:07.304521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-093cf2a2-f75e-4734-b4e1-44e1d60e5a23 req-cb975ed2-95dd-4b3d-9cb2-20198b852d46 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168981 May 11 18:58:07.307143 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 39/73] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:07.328196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bafc7b11-920f-4902-a1ed-2493f35b9f2a tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 2.005635 May 11 18:58:07.328196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 35/74] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:05 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:07.336897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:07.338784 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-2d683af7-34b1-41e8-9e43-9bfab86f62d3 req-00c35d89-b007-42f2-9067-479818d74f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:07.344432 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:07.375883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.377492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.379204 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.379940 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-2d683af7-34b1-41e8-9e43-9bfab86f62d3 req-00c35d89-b007-42f2-9067-479818d74f46 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.380395 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-2d683af7-34b1-41e8-9e43-9bfab86f62d3 req-00c35d89-b007-42f2-9067-479818d74f46 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.380995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.402828 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-2d683af7-34b1-41e8-9e43-9bfab86f62d3 req-00c35d89-b007-42f2-9067-479818d74f46 service nova] Creating event network-changed:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 18:58:07.421137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-2d683af7-34b1-41e8-9e43-9bfab86f62d3 req-00c35d89-b007-42f2-9067-479818d74f46 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109252 May 11 18:58:07.421757 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 40/75] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:07.768644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:07.769359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:07.782609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.785365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:07.788776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:07.790712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:08.753698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:08.779533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:08.781394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:08.791073 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e5190957-bd5d-4585-9b1e-5bb66ecb69f8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1407 microversion: 2.20 time: 1.459998 May 11 18:58:08.791774 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 36/76] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:07 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1407 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:08.810683 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:08.811322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:08.841268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:08.841896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:08.844251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:08.844702 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:09.024235 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:09.042931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d7927f9a-2df0-4349-b187-ff5d078188ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 1.281529 May 11 18:58:09.053921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 41/77] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:07 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:09.287055 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:09.301126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ea6a5466-53f9-41d0-b1b5-f3bcacc2f423 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 0.495846 May 11 18:58:09.311024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 37/78] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:08 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:09.809339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:09.809950 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:09.818832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:09.827609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:09.828543 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:09.828995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:10.060464 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:10.061686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:10.072870 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:10.073610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:10.074568 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:10.075006 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:10.435765 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:10.483663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:10.486595 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:10.496318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0dae709f-89e3-4d76-b9ed-5ad21aa7b6a7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1407 microversion: 2.20 time: 0.690862 May 11 18:58:10.500360 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 42/79] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:09 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1407 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:10.519074 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:10.521144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:10.532953 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:10.534733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:10.536868 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:10.539357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:10.980373 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:10.989873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7d12d822-019b-4984-8de2-d71af6074c55 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.930959 May 11 18:58:10.990330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 38/80] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:10 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:11.007647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-d16f77f4-3f39-41ef-9b1f-f5b348d90f52 req-9c272287-5feb-4dc3-99b3-81c4f0f0b72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b93674-b607-42d9-bd2d-9abdce312e40", "tag": "dd66c0eb-ac6a-4a7c-86bb-71dd9be5ff56"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:11.023938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-d16f77f4-3f39-41ef-9b1f-f5b348d90f52 req-9c272287-5feb-4dc3-99b3-81c4f0f0b72e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:11.030380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-d16f77f4-3f39-41ef-9b1f-f5b348d90f52 req-9c272287-5feb-4dc3-99b3-81c4f0f0b72e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:11.065489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-d16f77f4-3f39-41ef-9b1f-f5b348d90f52 req-9c272287-5feb-4dc3-99b3-81c4f0f0b72e service nova] Creating event network-changed:dd66c0eb-ac6a-4a7c-86bb-71dd9be5ff56 for instance 54b93674-b607-42d9-bd2d-9abdce312e40 on hv-cinder-75510 May 11 18:58:11.074791 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-d16f77f4-3f39-41ef-9b1f-f5b348d90f52 req-9c272287-5feb-4dc3-99b3-81c4f0f0b72e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081522 May 11 18:58:11.075935 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 39/81] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:11.216240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:11.238259 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2fb16720-f878-42c0-969a-564616881fa2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1314 microversion: 2.1 time: 0.732224 May 11 18:58:11.244624 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 43/82] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:10 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:11.487680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1535032339", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd681a56-5e31-47e5-a902-5d88ec1edff4"}], "security_groups": [{"name": "tempest-securitygroup--1070705352"}], "key_name": "tempest-keypair-905375014", "user_data": "}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:11.517014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:11.517800 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:11.525320 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:11.525697 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:11.527168 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:11.527168 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:11.664380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] validate_networks() for [('bd681a56-5e31-47e5-a902-5d88ec1edff4', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:58:11.747888 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:11.757836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:11.764598 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:11.768693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0638c058-baa9-434b-a0b7-b16da82cd216 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1407 microversion: 2.20 time: 0.255427 May 11 18:58:11.769266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 44/83] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:11 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:58:11.790165 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-202241380", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834a0-4dee-47c7-b460-ae66831e3d5b"}], "security_groups": [{"name": "tempest-securitygroup--1729446455"}], "key_name": "tempest-keypair-1983102623", "user_data": "}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:12.181828 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] validate_networks() for [('6b6834a0-4dee-47c7-b460-ae66831e3d5b', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:58:12.798444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:58:12.799397 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:58:12.799891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:58:12.800449 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:58:12.803100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:58:12.813707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:12.814542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:12.815991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:12.816575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:12.847580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for project 35ad10e77d194397ba6a84cf39758839. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:58:12.854111 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for user f8edf1e5f81c4e81b346c82cb48a47f6 and project 35ad10e77d194397ba6a84cf39758839. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:58:12.872053 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:58:12.876050 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:58:12.910279 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:58:12.912299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:58:12.913274 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:58:12.913901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:58:12.914741 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:58:12.934010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:12.943266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:12.948148 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:12.950219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:12.996250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c21a6767-c103-4f83-bdaf-77ba363867ff tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.513121 May 11 18:58:13.002395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 40/84] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:58:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:58:13.012355 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:13.014548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:13.021272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:13.022181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:13.024113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:13.024900 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:13.047862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:58:13.056138 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:58:13.084689 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:58:13.087012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:58:13.176462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f98d91e2-b010-4e9a-9d87-5849e3d24178 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.401916 May 11 18:58:13.177394 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 45/85] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:58:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:58:13.196869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:13.197509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:13.221822 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:13.222551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:13.224538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:13.225399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.014357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.021694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.037597 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ecc82f2e-ad81-4500-a522-e42475502eb3 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1500 microversion: 2.1 time: 0.857427 May 11 18:58:14.038857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 46/86] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:13 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1500 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:14.044062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a6941b7b-a47d-4027-9f21-ffaf076884c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 1.040256 May 11 18:58:14.048740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 41/87] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:13 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:14.060722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:14.064506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:14.065748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:14.066525 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:14.082626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.083777 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.084647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.084971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.091912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.108494 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.112698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.116983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.264953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.273612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a0315d20-6ed6-48f0-bd96-650b6cc77d3e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1241 microversion: 2.1 time: 0.222992 May 11 18:58:14.276893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 42/88] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:14 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1241 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:14.288175 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-84ed4c88-4fff-4ddc-bd26-c38a40d3554f req-97333861-722e-4650-af2a-03b2e2caf120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "name": "network-vif-plugged", "status": "completed", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:14.308249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-84ed4c88-4fff-4ddc-bd26-c38a40d3554f req-97333861-722e-4650-af2a-03b2e2caf120 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.308382 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-84ed4c88-4fff-4ddc-bd26-c38a40d3554f req-97333861-722e-4650-af2a-03b2e2caf120 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.338919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-84ed4c88-4fff-4ddc-bd26-c38a40d3554f req-97333861-722e-4650-af2a-03b2e2caf120 service nova] Creating event network-vif-plugged:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 18:58:14.351157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-84ed4c88-4fff-4ddc-bd26-c38a40d3554f req-97333861-722e-4650-af2a-03b2e2caf120 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070932 May 11 18:58:14.374820 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 43/89] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:14.396911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:14.396911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:14.435118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.437427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.438284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:14.445626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:14.546326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.559651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.562916 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.564712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b06334ea-6a4a-43a8-bc2b-295c7c9e3cdf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1407 microversion: 2.20 time: 0.524174 May 11 18:58:14.565860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 47/90] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:14 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:14.748933 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:14.766357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c3a0607b-5ca1-41be-9451-dcd028531dd3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1237 microversion: 2.1 time: 0.389889 May 11 18:58:14.767522 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 44/91] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:14 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1237 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:15.064278 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:15.064886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:15.076198 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.077015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.078994 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.080858 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.293927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:15.294543 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:15.306124 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.306590 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.308402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.309170 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.393981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:15.425079 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e509393a-8516-4401-90ba-b631a9a15bd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1289 microversion: 2.1 time: 0.135038 May 11 18:58:15.430166 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 45/92] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:15 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:15.448959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:15.462779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2f4e42c6-7e08-47f2-9451-a98c5976e590 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.402128 May 11 18:58:15.468681 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 48/93] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:15 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:15.587189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:15.588016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:15.603666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.609363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.611045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.611712 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.784953 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:15.785980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:15.794125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.794909 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.796055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.796718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.830751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:15.844729 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:15.847540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:15.855342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0c9219ca-8135-4c17-93f3-6f74529ef092 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1407 microversion: 2.20 time: 0.275233 May 11 18:58:15.859517 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 46/94] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:15 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:15.897941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df4ba634-69d2-43ef-ae7e-ad9dd7f5874c"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:15.899023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:15.906136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.906637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.907465 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:15.907908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:15.920998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:15.932914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e453a88f-197d-4387-88e2-f309a55d6931 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1299 microversion: 2.1 time: 0.152378 May 11 18:58:15.940166 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 49/95] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:15 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:16.414975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-2c511ce3-e901-4f50-bb1d-d405afb7a1c2 req-ff2eca97-ae23-4038-802e-6a0f6358a9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57bf0b3-ec26-4008-9534-60b21519c99c", "name": "network-vif-plugged", "status": "completed", "tag": "6b468130-64ed-447f-acd8-06ef735243a3"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:16.456262 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-2c511ce3-e901-4f50-bb1d-d405afb7a1c2 req-ff2eca97-ae23-4038-802e-6a0f6358a9e8 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:16.456711 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-2c511ce3-e901-4f50-bb1d-d405afb7a1c2 req-ff2eca97-ae23-4038-802e-6a0f6358a9e8 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:16.506194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-2c511ce3-e901-4f50-bb1d-d405afb7a1c2 req-ff2eca97-ae23-4038-802e-6a0f6358a9e8 service nova] Creating event network-vif-plugged:6b468130-64ed-447f-acd8-06ef735243a3 for instance b57bf0b3-ec26-4008-9534-60b21519c99c on hv-cinder-75510 May 11 18:58:16.514876 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-2c511ce3-e901-4f50-bb1d-d405afb7a1c2 req-ff2eca97-ae23-4038-802e-6a0f6358a9e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113986 May 11 18:58:16.517069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 50/96] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:16.526594 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:16.528121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:16.535750 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:16.537078 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:16.538425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:16.539693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:16.673041 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:16.681296 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-08cc8bb9-581d-43c0-a85f-3dd64da1fbd6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1295 microversion: 2.1 time: 0.161138 May 11 18:58:16.698500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 51/97] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:16 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1295 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:16.704037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:16.704848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:16.712067 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:16.712740 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:16.713660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:16.714258 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:16.999282 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:17.010613 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d2a36c93-5dc9-4636-9bbe-fc6fffd73958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.308910 May 11 18:58:17.011243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 52/98] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:16 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:17.021389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:17.022432 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:17.035679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.037099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.038773 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.039926 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.079116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-06486a13-c68c-430c-802b-4d2c7273761d tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "POST /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182956 May 11 18:58:17.086289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 47/99] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 18:58:15 2022] POST /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316/os-volume_attachments => generated 194 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:58:17.092825 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:17.093737 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:17.101731 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.102468 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.103645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.104350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.241245 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:17.256848 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c340f2f8-e413-45df-a265-1a440a23b291 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1299 microversion: 2.1 time: 0.168739 May 11 18:58:17.257566 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 48/100] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:17 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:17.259121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:17.274791 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:17.276335 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:17.277869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1ceb3ca1-6c6e-4a83-b81a-24259c0f3948 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1598 microversion: 2.20 time: 0.263525 May 11 18:58:17.278771 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 53/101] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:58:17 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1598 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:58:17.295973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:17.296793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:17.303099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.303854 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.304815 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.305433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.461852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-248411a3-a33b-4ce6-92c3-ccb726387cb1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.169621 May 11 18:58:17.463278 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 49/102] 10.222.0.93 () {60 vars in 1315 bytes} [Wed May 11 18:58:17 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 18:58:17.698781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:17.699799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:17.711188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.711876 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.712880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:17.713477 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:17.965924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:17.974748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6a87acc5-d03f-4dab-9bb8-a4519216b62c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1295 microversion: 2.1 time: 0.280277 May 11 18:58:17.975339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 54/103] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:17 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1295 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:18.028143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:18.029110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:18.056606 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:18.059818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:18.060891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:18.061534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:18.282407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:18.287358 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:18.306482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:18.306959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:18.313528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:18.313990 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:18.502292 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:18.514717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d6840e71-4f61-4ef3-ab93-2c5b38e761ac tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.490865 May 11 18:58:18.515445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 50/104] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:18 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:18.537385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-f3318157-a359-4163-828f-2304b22cd11d req-f7344886-0af6-4672-8f26-07750d5a7b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b93674-b607-42d9-bd2d-9abdce312e40", "name": "network-vif-plugged", "status": "completed", "tag": "dd66c0eb-ac6a-4a7c-86bb-71dd9be5ff56"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:18.546321 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-f3318157-a359-4163-828f-2304b22cd11d req-f7344886-0af6-4672-8f26-07750d5a7b48 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:18.546762 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-f3318157-a359-4163-828f-2304b22cd11d req-f7344886-0af6-4672-8f26-07750d5a7b48 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:18.582759 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-f3318157-a359-4163-828f-2304b22cd11d req-f7344886-0af6-4672-8f26-07750d5a7b48 service nova] Creating event network-vif-plugged:dd66c0eb-ac6a-4a7c-86bb-71dd9be5ff56 for instance 54b93674-b607-42d9-bd2d-9abdce312e40 on hv-cinder-75510 May 11 18:58:18.587870 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-f3318157-a359-4163-828f-2304b22cd11d req-f7344886-0af6-4672-8f26-07750d5a7b48 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054101 May 11 18:58:18.588953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 51/105] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:18.995002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:18.995807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:19.011587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:19.017154 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:19.018259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:19.018911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:19.081710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:19.097349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-021473aa-52cf-411d-be21-8c8025ca0951 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.823675 May 11 18:58:19.100958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 55/106] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:18 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:19.532149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:19.532755 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:19.547742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:19.548225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:19.549048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:19.549479 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:19.833911 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:19.847144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9813c08d-a8f9-4392-8ac2-d64a21a1b9dc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.315643 May 11 18:58:19.860015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 56/107] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:19 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:19.872275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-30755e55-2750-4c44-9ce9-4d102a7f07fa req-371fb049-a05f-4c3e-aacd-8fa91229aebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448cb11d-d94b-46e6-bf14-e2ee5b9e93a6", "tag": "e5af5d5d-0808-45ef-abf7-442fa1ffa345"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:19.896071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:19.903879 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-799294c3-1314-46ef-a658-f8e963bc6c82 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.914790 May 11 18:58:19.904469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 52/108] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:18 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:19.908248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-30755e55-2750-4c44-9ce9-4d102a7f07fa req-371fb049-a05f-4c3e-aacd-8fa91229aebe service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:19.908880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-30755e55-2750-4c44-9ce9-4d102a7f07fa req-371fb049-a05f-4c3e-aacd-8fa91229aebe service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:19.936919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-30755e55-2750-4c44-9ce9-4d102a7f07fa req-371fb049-a05f-4c3e-aacd-8fa91229aebe service nova] Creating event network-changed:e5af5d5d-0808-45ef-abf7-442fa1ffa345 for instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 on hv-cinder-75510 May 11 18:58:19.945817 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-30755e55-2750-4c44-9ce9-4d102a7f07fa req-371fb049-a05f-4c3e-aacd-8fa91229aebe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084284 May 11 18:58:19.948666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 57/109] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:20.005173 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-b32d5e72-c62d-4c94-b841-136626326f63 req-5e248641-2afb-466c-8377-c9eb90130429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:20.025183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-b32d5e72-c62d-4c94-b841-136626326f63 req-5e248641-2afb-466c-8377-c9eb90130429 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.025621 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-b32d5e72-c62d-4c94-b841-136626326f63 req-5e248641-2afb-466c-8377-c9eb90130429 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:20.057756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-b32d5e72-c62d-4c94-b841-136626326f63 req-5e248641-2afb-466c-8377-c9eb90130429 service nova] Creating event network-changed:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 18:58:20.071074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-b32d5e72-c62d-4c94-b841-136626326f63 req-5e248641-2afb-466c-8377-c9eb90130429 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067460 May 11 18:58:20.072616 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 53/110] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:20.119103 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:20.119838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:20.139997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.140446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:20.141229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.142497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:20.465701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:20.487656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-eff830e7-719c-4d25-8c94-2036ecf1dba1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.373207 May 11 18:58:20.491226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 58/111] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:20 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:20.865682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:20.866672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:20.885120 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.888936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:20.889759 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.890342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:20.920043 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:20.921709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:20.931578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.932615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:20.934221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:20.935035 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:21.145004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:21.155092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-641a8284-0057-438f-8439-7af850e3ce61 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1322 microversion: 2.1 time: 0.293516 May 11 18:58:21.157170 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 54/112] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:20 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:21.176775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:21.184686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-272e58a7-94f9-4d52-aa12-d825cc07ec57 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.268623 May 11 18:58:21.203722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 59/113] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:20 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:21.508970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:21.509687 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:21.516708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:21.517421 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:21.518835 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:21.519612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:21.845666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:21.853564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-08dcdec7-c6c1-4f11-941d-16303e4772ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.351365 May 11 18:58:21.854135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 55/114] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:21 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:21.969352 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-10bbe226-ab63-435e-98e9-c2e11ba58ba7 req-783fd9a8-8710-444a-b32e-44e01d10775b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8", "tag": "e8360471-a390-41bb-94e5-cfb5a5d2040d"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:21.978005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-10bbe226-ab63-435e-98e9-c2e11ba58ba7 req-783fd9a8-8710-444a-b32e-44e01d10775b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:21.978451 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-10bbe226-ab63-435e-98e9-c2e11ba58ba7 req-783fd9a8-8710-444a-b32e-44e01d10775b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:21.990358 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-10bbe226-ab63-435e-98e9-c2e11ba58ba7 req-783fd9a8-8710-444a-b32e-44e01d10775b service nova] Creating event network-changed:e8360471-a390-41bb-94e5-cfb5a5d2040d for instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 on hv-cinder-75510 May 11 18:58:21.995050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-10bbe226-ab63-435e-98e9-c2e11ba58ba7 req-783fd9a8-8710-444a-b32e-44e01d10775b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029997 May 11 18:58:21.995698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 60/115] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:22.174737 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:22.175504 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:22.182029 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.182483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.183286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.183707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.202165 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:22.204102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:22.211036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.211542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.212383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.212826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.324021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:22.331613 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-af3abc96-f5bf-4650-ab0e-602da1c69897 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1516 microversion: 2.1 time: 0.161188 May 11 18:58:22.337600 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 56/116] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:22 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:22.356557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:22.357617 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:22.365697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.366154 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.366940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.367404 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.421410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'flavor' on Instance uuid 54b93674-b607-42d9-bd2d-9abdce312e40 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:58:22.429117 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:22.440243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2bada6ab-5120-4778-a647-1fb7c9f5b7c1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.242014 May 11 18:58:22.440830 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 61/117] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:22 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:22.595502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0fd01071-a7e9-4414-b2b0-092ce8d20323 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40/action" status: 200 len: 32 microversion: 2.1 time: 0.242890 May 11 18:58:22.596304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 57/118] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 18:58:22 2022] POST /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 18:58:22.606806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:22.607833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:22.617979 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.618693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.619877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.620502 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.850076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:22.857690 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cb0ddb22-206b-4491-b5dd-a77d9e0f2296 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.255449 May 11 18:58:22.870491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 62/119] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:22 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:22.874146 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:22.875014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:22.883513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.884068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:22.885730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:22.886398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:23.230799 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:23.241038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f9d40c4e-ac4b-47c8-90f5-a21acf25d44f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.372713 May 11 18:58:23.242390 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 58/120] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:22 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:23.459621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:23.460080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:23.467634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:23.468248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:23.469073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:23.469517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:23.627257 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:23.634512 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b0242fdf-2043-491d-9b2f-facca67e0e45 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.179186 May 11 18:58:23.635114 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 63/121] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:23 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:23.878384 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:23.879080 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:23.886524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:23.887400 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:23.888843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:23.889332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:24.088164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:24.104665 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fe05755b-38d1-4d98-8ac5-c6fb8f188955 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.229074 May 11 18:58:24.106426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 59/122] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:23 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:24.263793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:24.263793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:24.278038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:24.278498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:24.279250 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:24.279708 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:24.439498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:24.448026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5b2e1239-3076-4ffb-8560-c985af204683 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.193347 May 11 18:58:24.449111 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 64/123] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:24 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:24.652753 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:24.653366 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:24.661987 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:24.663499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:24.664803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:24.665644 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:24.857272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:24.866064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3da2b84d-a0c1-49b8-8424-ab32c036c708 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.218382 May 11 18:58:24.866674 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 60/124] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:24 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:25.123908 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:25.124446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:25.133380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:25.134206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:25.135061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:25.135592 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:25.268655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:25.277776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a71a64f9-7e38-4e41-a049-21d0f2cd34b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.159607 May 11 18:58:25.278510 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 65/125] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:25 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:25.464309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:25.465027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:25.470998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:25.471493 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:25.472309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:25.472777 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:25.675353 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:25.683425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c56f8bcc-0fa1-43ea-91b8-e08075dd2470 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.222824 May 11 18:58:25.684009 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 61/126] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:25 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:25.886323 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:25.887013 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:25.904422 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:25.904900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:25.906885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:25.907520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:26.119808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:26.128085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-be4d47f9-ae5f-4dc8-b458-386563de637b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.246243 May 11 18:58:26.128658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 66/127] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:25 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:26.294794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:26.295643 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:26.305909 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:26.306368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:26.307810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:26.308257 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:26.465337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:26.473591 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7de16af8-76b5-48d4-b9e3-33f73996b958 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.182142 May 11 18:58:26.474172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 62/128] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:26 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:26.702034 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:26.702925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:26.709589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:26.710122 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:26.711028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:26.711557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:26.983480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-b3992bbb-f893-45c3-a6bc-12d29e067fa0 req-3788a129-e1f6-4609-9a6a-09faa36782cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448cb11d-d94b-46e6-bf14-e2ee5b9e93a6", "name": "network-vif-plugged", "status": "completed", "tag": "e5af5d5d-0808-45ef-abf7-442fa1ffa345"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:27.007380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-b3992bbb-f893-45c3-a6bc-12d29e067fa0 req-3788a129-e1f6-4609-9a6a-09faa36782cb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:27.016635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:27.023052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-b3992bbb-f893-45c3-a6bc-12d29e067fa0 req-3788a129-e1f6-4609-9a6a-09faa36782cb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:27.025930 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-22f08a3d-c76b-422c-aaf3-d7b901629da8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.328052 May 11 18:58:27.037148 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 67/129] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:26 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:27.067673 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-b3992bbb-f893-45c3-a6bc-12d29e067fa0 req-3788a129-e1f6-4609-9a6a-09faa36782cb service nova] Creating event network-vif-plugged:e5af5d5d-0808-45ef-abf7-442fa1ffa345 for instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 on hv-cinder-75510 May 11 18:58:27.088686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-b3992bbb-f893-45c3-a6bc-12d29e067fa0 req-3788a129-e1f6-4609-9a6a-09faa36782cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106312 May 11 18:58:27.091621 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 63/130] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:58:27.146349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:27.147651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:27.163096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:27.163604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:27.164418 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:27.174375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:27.358865 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:27.368264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-99f1fb55-b66f-4052-8d59-d08bfee222a3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.226377 May 11 18:58:27.369149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 68/131] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:27 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:27.492165 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:27.492998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:27.501762 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:27.502983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:27.504845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:27.506562 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:27.779278 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:27.799181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-17f31833-e87f-4d18-a3df-087cdeab4407 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.311708 May 11 18:58:27.799860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 64/132] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:27 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:28.054891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:28.055719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:28.065562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.066015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.067080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.067546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.260747 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:28.261224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:28.267563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.268231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.269141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.269582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:28.270784 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.288822 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-84d57efa-9110-4978-a7a2-ddf3fab7c7cf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.238597 May 11 18:58:28.292021 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 69/133] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:28 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:28.302736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 18:58:28.384733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:28.385592 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:28.391752 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.392416 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.393225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.393652 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.394409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4c306377-fbf6-425d-9e62-e7b082e9053c tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 204 len: 0 microversion: 2.1 time: 0.137208 May 11 18:58:28.398475 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 65/134] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 18:58:28 2022] DELETE /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 18:58:28.405036 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:28.405895 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:28.413343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.413795 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.414578 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.415015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.565738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:28.574216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-989d0458-7db6-445c-8b66-daf85b1534ee tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.193115 May 11 18:58:28.574795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 70/135] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:28 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:28.586764 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:28.595563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4ad6cd0c-01af-4182-9f5e-a0ebb71f3f83 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.195238 May 11 18:58:28.596136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 66/136] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:28 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:28.817947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:28.818545 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:28.824913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.825547 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.826575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:28.827154 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:28.979889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:28.988027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1ab4b4b1-07fb-486e-a987-812b42c3d093 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.174947 May 11 18:58:28.998896 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 71/137] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:28 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:29.309392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:29.310814 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:29.320348 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:29.321688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:29.322716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:29.323155 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:29.592259 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:29.593022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:29.613151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:29.614892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:29.620250 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:29.623177 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:29.644582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:29.657058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-05f2de53-7f6b-4d61-9882-bfbd9e2c0b6b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.352440 May 11 18:58:29.657660 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 67/138] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:29 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:29.676197 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:29.677849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:29.692309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:29.692977 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:29.693790 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:29.694499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:29.891062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:29.901387 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b156dc32-8dd1-4c4b-ab5a-da654d5dcc31 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.242709 May 11 18:58:29.906890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 68/139] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:29 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:29.913537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:29.931730 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7018035e-a5b2-490a-b61e-56314f89738f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.343461 May 11 18:58:29.932335 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 72/140] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:29 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:30.007531 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:30.008054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:30.016963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.017453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.018451 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.018905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.277343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:30.285048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4446a4dd-b935-4cb4-8c51-29d7d074ed98 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.282751 May 11 18:58:30.285668 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 69/141] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:30 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:30.677703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:30.679407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:30.686352 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.686869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.687882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.688676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.840850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:30.850398 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b1f374fc-0460-49b5-a58c-b9ab099dcf57 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.179671 May 11 18:58:30.867553 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 73/142] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:30 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:30.921505 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:30.922208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:30.929926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.930851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.931741 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.932172 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.949888 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:30.950548 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:30.964649 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.965144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:30.966227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:30.966925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:31.133645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:31.141624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0839eb78-53ad-4342-ac74-1de9e5160787 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.224349 May 11 18:58:31.142303 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 70/143] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:30 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:31.143770 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:31.153500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1ace3bd2-adde-498c-be7c-109dca2e5f80 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.208605 May 11 18:58:31.154155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 74/144] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:30 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:31.156454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-248b1ac2-439e-46b4-b924-c910a177635a req-bdfa82c5-28bb-4792-99d4-eb97aea8bfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8", "name": "network-vif-plugged", "status": "completed", "tag": "e8360471-a390-41bb-94e5-cfb5a5d2040d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:31.167181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-248b1ac2-439e-46b4-b924-c910a177635a req-bdfa82c5-28bb-4792-99d4-eb97aea8bfd7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:31.167658 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-248b1ac2-439e-46b4-b924-c910a177635a req-bdfa82c5-28bb-4792-99d4-eb97aea8bfd7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:31.178509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-248b1ac2-439e-46b4-b924-c910a177635a req-bdfa82c5-28bb-4792-99d4-eb97aea8bfd7 service nova] Creating event network-vif-plugged:e8360471-a390-41bb-94e5-cfb5a5d2040d for instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 on hv-cinder-75510 May 11 18:58:31.183418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-248b1ac2-439e-46b4-b924-c910a177635a req-bdfa82c5-28bb-4792-99d4-eb97aea8bfd7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039600 May 11 18:58:31.183989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 71/145] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:31.301138 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:31.301735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:31.307634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:31.308078 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:31.308831 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:31.309266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:31.449480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:31.459754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d5bd83ac-a300-461e-ad39-e8f3b96c58bd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.162322 May 11 18:58:31.460361 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 75/146] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:31 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:31.867278 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:31.868026 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:31.874066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:31.874514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:31.875273 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:31.876134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.008827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:32.013783 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1827293370", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "networks": [{"uuid": "95df4839-1eaa-4a99-b24c-59375c2425ed"}]}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:32.026052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bd0706fe-152d-423a-a70c-06bca1f617fa tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1367 microversion: 2.1 time: 0.163438 May 11 18:58:32.026637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 72/147] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:31 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:32.065934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] validate_networks() for [('95df4839-1eaa-4a99-b24c-59375c2425ed', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:58:32.159391 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:32.159992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:32.168176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.168626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.169382 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.170082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.305140 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:32.313179 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d9a8312d-a9c9-40d2-8b71-a9b4d60d8ac2 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.157655 May 11 18:58:32.313750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 73/148] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:32 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:32.319464 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:32.320506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:32.327040 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.327536 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.328317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.328770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.462127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:58:32.462551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:58:32.463027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:58:32.463880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:58:32.464294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:58:32.474308 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.474871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.475803 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.476331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.494782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Getting quotas for project 335338c6d5e740d0b388702462e552ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:58:32.498723 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Getting quotas for user 04109028620d4b7284fbd32efc695c56 and project 335338c6d5e740d0b388702462e552ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:58:32.512131 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:58:32.514278 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:58:32.560329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-63945f74-6bda-45ae-9164-d33359707714 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550653 May 11 18:58:32.560974 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 76/149] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 18:58:32.565567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:32.566189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:32.573107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.573563 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.574329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:32.574758 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:32.607946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:32.615919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9697a195-fb4e-4bfd-82fa-f882d8fec52f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.301050 May 11 18:58:32.616493 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 74/150] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:32 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:32.627070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-76d95ca4-eff6-4837-aa4a-b0416e074cb5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:32.627778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-76d95ca4-eff6-4837-aa4a-b0416e074cb5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:32.685285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-76d95ca4-eff6-4837-aa4a-b0416e074cb5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:32.692934 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-76d95ca4-eff6-4837-aa4a-b0416e074cb5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1214 microversion: 2.1 time: 0.074557 May 11 18:58:32.694655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 75/151] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:32 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:32.719349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:32.726996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ebd37694-b10b-48c5-a193-d0a9cfa22a70 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.165083 May 11 18:58:32.727597 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 77/152] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:32 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:33.042472 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:33.042986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:33.049312 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.049762 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.050547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.051612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.175528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:33.183996 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1ffc51e3-8907-4799-82b8-4eefeb77df7a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1557 microversion: 2.1 time: 0.145462 May 11 18:58:33.184778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 76/153] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:33 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:33.201047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:33.201533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:33.207462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.207901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.208656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.209077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.319635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ed90920a-c170-44d7-bb40-22202b7f9a9a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122046 May 11 18:58:33.320232 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 78/154] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 18:58:33 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:33.330852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:33.331491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:33.337482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.337924 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.338677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.339104 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.632336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:33.632891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:33.638780 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.639225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.640106 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.640541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.646954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:33.655407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c9ef04c1-f95a-49ce-8b0f-c93a384c805b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.328257 May 11 18:58:33.656063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 77/155] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:33 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:33.710410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:33.711012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:33.716981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.717509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.718345 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.719023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.788987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:33.796326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b44d4605-51f3-4d98-8e26-bcc97bdacb1a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.168063 May 11 18:58:33.796893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 79/156] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:33 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:33.801318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:33.801913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:33.807522 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.807966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.808716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:33.809150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:33.839570 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:33.846892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7023889f-39e3-411a-b5eb-6e57520e7a9b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1218 microversion: 2.1 time: 0.140772 May 11 18:58:33.847804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 78/157] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:33 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:33.933189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:33.940579 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-dfe86ef8-532e-44ae-9581-54bdd3249c16 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.142747 May 11 18:58:33.941144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 80/158] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:33 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:34.673142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:34.673758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:34.680032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.680486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.681254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.681693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.811207 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-281aba41-57e5-4b84-bac7-bf2d02883e0b req-45bdda0e-97db-4725-ab0c-c6fa691dfe69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448cb11d-d94b-46e6-bf14-e2ee5b9e93a6", "tag": "e5af5d5d-0808-45ef-abf7-442fa1ffa345"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:34.820335 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-281aba41-57e5-4b84-bac7-bf2d02883e0b req-45bdda0e-97db-4725-ab0c-c6fa691dfe69 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.820884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-281aba41-57e5-4b84-bac7-bf2d02883e0b req-45bdda0e-97db-4725-ab0c-c6fa691dfe69 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.833172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-281aba41-57e5-4b84-bac7-bf2d02883e0b req-45bdda0e-97db-4725-ab0c-c6fa691dfe69 service nova] Creating event network-changed:e5af5d5d-0808-45ef-abf7-442fa1ffa345 for instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 on hv-cinder-75510 May 11 18:58:34.838581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-281aba41-57e5-4b84-bac7-bf2d02883e0b req-45bdda0e-97db-4725-ab0c-c6fa691dfe69 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 May 11 18:58:34.839359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 81/159] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:58:34.848230 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:34.849046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:34.850586 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:34.856229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.856823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.857779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.858360 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.859579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-569c51cb-ddc8-4446-a739-91cb6a003c39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.190238 May 11 18:58:34.860342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 79/160] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:34 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:34.866143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:34.866894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:34.875116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.875941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.876861 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.877418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.939854 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:34.948657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b71e4242-f8b6-477d-99f9-f81847629d67 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1218 microversion: 2.1 time: 0.087473 May 11 18:58:34.949439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 80/161] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:34 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:34.962650 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:34.963577 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:34.970214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.970931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:34.971827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:34.972338 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:35.003860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:35.012293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-78a393aa-e6b6-477b-a05c-cb19552541d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.168427 May 11 18:58:35.013024 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 82/162] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:34 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:35.105293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:35.112730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bc7d7b94-6707-44af-81f4-12dbaafae614 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.153809 May 11 18:58:35.113307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 81/163] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:34 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:35.877179 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:35.877788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:35.885155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:35.885607 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:35.886379 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:35.886816 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:35.965909 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:35.966526 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:35.979022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:35.979501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:35.980289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:35.980725 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:36.076761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:36.090804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d0a064f6-551d-4d5b-83b5-de30ddcd8d01 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1218 microversion: 2.1 time: 0.129195 May 11 18:58:36.091912 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 82/164] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:35 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:36.098366 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:36.100117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:36.111858 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:36.112364 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:36.113344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:36.114550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:36.131318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:36.139919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-89056449-9a29-41da-8eb1-6a7b6b411fd7 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.266609 May 11 18:58:36.142181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 83/165] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:35 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:36.146775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:36.147381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:36.154483 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:36.154928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:36.155743 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:36.156299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:36.270135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:36.278746 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-003563dd-92d0-4e5f-82c4-0d60628b267a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.184867 May 11 18:58:36.279385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 83/166] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:36 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:36.321977 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:36.332432 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-273aea78-cdbc-49ca-aa8d-738a77850d2e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.188983 May 11 18:58:36.333337 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 84/167] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:36 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:36.584454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-0f3f91fb-e3ad-4696-b0a2-16f8bdb713d2 req-6b8bc0cd-588e-4209-8d5d-9d4673f17506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c97b0e6-b48c-4d3a-8a1d-46f124ac2316", "name": "network-vif-unplugged", "status": "completed", "tag": "9b9f56a8-cd55-4727-86cb-d96b8e75c6d8"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:36.597778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-0f3f91fb-e3ad-4696-b0a2-16f8bdb713d2 req-6b8bc0cd-588e-4209-8d5d-9d4673f17506 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:36.597778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-0f3f91fb-e3ad-4696-b0a2-16f8bdb713d2 req-6b8bc0cd-588e-4209-8d5d-9d4673f17506 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:36.613658 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-0f3f91fb-e3ad-4696-b0a2-16f8bdb713d2 req-6b8bc0cd-588e-4209-8d5d-9d4673f17506 service nova] Creating event network-vif-unplugged:9b9f56a8-cd55-4727-86cb-d96b8e75c6d8 for instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 on hv-cinder-75510 May 11 18:58:36.627231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-0f3f91fb-e3ad-4696-b0a2-16f8bdb713d2 req-6b8bc0cd-588e-4209-8d5d-9d4673f17506 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062542 May 11 18:58:36.628213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 84/168] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:37.107689 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:37.108330 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:37.115134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.115699 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.117695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.118137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.161244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:37.161985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:37.169580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.170027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.170832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.171224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.201571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:37.211506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c87bc617-dd46-40f4-8e65-4708ba861f62 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1210 microversion: 2.1 time: 0.107657 May 11 18:58:37.212262 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 85/169] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:37 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:37.295888 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:37.296489 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:37.303375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.304132 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.305063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.305661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.365531 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:37.378280 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5d185eea-67f6-42b7-a198-a5d035beaae0 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1552 microversion: 2.1 time: 0.222763 May 11 18:58:37.390257 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 85/170] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:37 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1552 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:37.408801 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:37.409832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:37.419258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.419740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.420547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.421008 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.622683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:37.631506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-940814a1-9767-4e0e-9847-7d8e42e081f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1363 microversion: 2.1 time: 0.339295 May 11 18:58:37.632643 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 86/171] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:37 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:37.663485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:37.671963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ed1d1d66-7bb9-4f6d-ba94-3d2b14897fe5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.279463 May 11 18:58:37.672891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 86/172] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:37 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:37.967079 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-043896f5-639d-4672-ba05-6183fc497997 req-ff236134-a06d-4185-b19d-6fa28b4b48be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c97b0e6-b48c-4d3a-8a1d-46f124ac2316", "name": "network-vif-deleted", "tag": "9b9f56a8-cd55-4727-86cb-d96b8e75c6d8"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:37.975656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-043896f5-639d-4672-ba05-6183fc497997 req-ff236134-a06d-4185-b19d-6fa28b4b48be service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:37.976108 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-043896f5-639d-4672-ba05-6183fc497997 req-ff236134-a06d-4185-b19d-6fa28b4b48be service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:37.987170 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-043896f5-639d-4672-ba05-6183fc497997 req-ff236134-a06d-4185-b19d-6fa28b4b48be service nova] Creating event network-vif-deleted:9b9f56a8-cd55-4727-86cb-d96b8e75c6d8 for instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 on hv-cinder-75510 May 11 18:58:37.992239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-043896f5-639d-4672-ba05-6183fc497997 req-ff236134-a06d-4185-b19d-6fa28b4b48be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028740 May 11 18:58:37.992836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 87/173] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:38.229806 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:38.230446 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:38.237208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.237661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.238473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.238920 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.306604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:38.314012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-dda47c10-8fd7-445c-86c5-7cce223c2301 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1274 microversion: 2.1 time: 0.088080 May 11 18:58:38.314584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 87/174] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:38 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:38.397086 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:38.397803 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:38.404624 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.405075 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.405848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.406509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.482879 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:38.492190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8aded1f1-4fd9-4a2a-b1d3-1597e2142648 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1345 microversion: 2.1 time: 0.100100 May 11 18:58:38.502361 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 88/175] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:38 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:38.648057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:38.648652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:38.654471 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.654876 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.655657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.656087 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.689769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:38.690520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:38.697538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.698083 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.698852 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.699289 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.783454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:38.791243 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4543a80c-94c6-4d9a-8f97-f1f6e3520b44 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1548 microversion: 2.1 time: 0.146956 May 11 18:58:38.791950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 88/176] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:38 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:38.809011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:38.809410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:38.815807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.816249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.817604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:38.818035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:38.900344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9eaa063e-4659-4857-a3b4-08276fb00555 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095315 May 11 18:58:38.900949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 89/177] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 18:58:38 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:58:39.012102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:39.019620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2576f974-4c7b-4bbb-a64a-71a1bb53fb82 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.333459 May 11 18:58:39.020285 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 89/178] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:38 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:39.335056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:39.336287 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:39.345425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:39.346512 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:39.348267 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:39.349026 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:39.435641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:39.450690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6f91d215-ec63-4fec-8d21-8ef5093af47c tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1272 microversion: 2.1 time: 0.122443 May 11 18:58:39.461301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 90/179] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:39 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:39.511273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:39.512692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:39.521243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:39.521913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:39.523390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:39.524233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:39.680057 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29349dabed5746449cefe237fd3739c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbf31f703e849cfa03c63580dee547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:39.689228 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c2974793-ef69-43e9-a8db-f38aa88c909b tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 200 len: 1345 microversion: 2.1 time: 0.184041 May 11 18:58:39.696456 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 90/180] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:39 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 1345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:39.834933 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-685550727", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:39.899943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] validate_networks() for None {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:58:40.037252 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:40.037861 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:40.043772 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.044429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.045392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.045823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.185686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:40.193710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-51d29889-822b-4bad-9da9-75559d401ba5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.160849 May 11 18:58:40.194455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 91/181] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:40 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:40.468321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:40.469176 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:40.475855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.476303 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.477080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.477654 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.548690 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:40.556755 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ad7ed6e8-d8e8-4819-b2eb-3cb107fb00c0 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1272 microversion: 2.1 time: 0.092396 May 11 18:58:40.557339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 92/182] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:40 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:40.613817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:58:40.614294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:58:40.614701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:58:40.615113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:58:40.615560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:58:40.624371 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.624824 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.625637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.626080 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.645539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Getting quotas for project c6ef1c88946b43a4a38adb2597263432. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:58:40.649950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Getting quotas for user 8522fa28726b4abbbc022de1c37fee11 and project c6ef1c88946b43a4a38adb2597263432. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:58:40.660940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:58:40.663199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:58:40.706665 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-04ec13f8-0724-47f7-8eec-609676fb5476 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876999 May 11 18:58:40.708256 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 91/183] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:58:40.722232 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fea8074e-9b56-4005-976d-e945bc26ef12 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:40.723192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fea8074e-9b56-4005-976d-e945bc26ef12 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:40.737338 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:40.738518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:40.754516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.754968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.755938 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.756183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.781852 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] HTTP exception thrown: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Request method failure captured: May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 HTTP/1.1 May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAccQTVKx8H2W4Wp9Ju7fIvOKrKFpqs-jhIPuqXyug58ZNo02xET8e_-9akhelNXkmkL-BtAKvdll_cc1DtTP_NVluSQUZd6qBPx40XbDh75KEkMoxg0y9tKvzYgbfjHADI7PF-O9UPrO8xbh_6cO6mqb1E3HspLv5UzoqCpjN3iLYU May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:58:40.787025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2fbf31f703e849cfa03c63580dee547a", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-DeleteServersTestJSON-575555770 May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 29349dabed5746449cefe237fd3739c3 May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.788410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '6c97b0e6-b48c-4d3a-8a1d-46f124ac2316'} May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:58:40.789119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.790193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.792431 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Returning 404 to user: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:58:40.793724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cb7cf3a2-af33-4876-bc25-e154772495da tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 404 len: 111 microversion: 2.1 time: 0.081527 May 11 18:58:40.794987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 93/184] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:40 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 18:58:40.858481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fea8074e-9b56-4005-976d-e945bc26ef12 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:40.869522 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fea8074e-9b56-4005-976d-e945bc26ef12 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1214 microversion: 2.1 time: 0.152922 May 11 18:58:40.871336 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 92/185] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:40 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:40.951273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:40.952670 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:40.962315 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.963409 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.964413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:40.965063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:40.982367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] HTTP exception thrown: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Request method failure captured: May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316/os-volume_attachments HTTP/1.1 May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAccQTVKx8H2W4Wp9Ju7fIvOKrKFpqs-jhIPuqXyug58ZNo02xET8e_-9akhelNXkmkL-BtAKvdll_cc1DtTP_NVluSQUZd6qBPx40XbDh75KEkMoxg0y9tKvzYgbfjHADI7PF-O9UPrO8xbh_6cO6mqb1E3HspLv5UzoqCpjN3iLYU May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:58:40.987264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2fbf31f703e849cfa03c63580dee547a", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-DeleteServersTestJSON-575555770 May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 29349dabed5746449cefe237fd3739c3 May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.988968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'server_id': '6c97b0e6-b48c-4d3a-8a1d-46f124ac2316'} May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:58:40.989615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:40.990585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:40.996062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Returning 404 to user: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:58:40.997246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-727dfd0a-7b55-4f0f-8c9d-5c6c4937bb39 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056018 May 11 18:58:41.008233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 94/186] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 18:58:40 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:58:41.168208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-609d1441-8811-447f-b57e-b1e9b9bccb23 req-37f2397b-229d-4f01-985d-d53294ec77ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8", "tag": "e8360471-a390-41bb-94e5-cfb5a5d2040d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:41.184635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-609d1441-8811-447f-b57e-b1e9b9bccb23 req-37f2397b-229d-4f01-985d-d53294ec77ee service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.185668 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-609d1441-8811-447f-b57e-b1e9b9bccb23 req-37f2397b-229d-4f01-985d-d53294ec77ee service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:41.213115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:41.214192 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:41.222718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-609d1441-8811-447f-b57e-b1e9b9bccb23 req-37f2397b-229d-4f01-985d-d53294ec77ee service nova] Creating event network-changed:e8360471-a390-41bb-94e5-cfb5a5d2040d for instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 on hv-cinder-75510 May 11 18:58:41.224185 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.225066 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:41.227839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.229259 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:41.233122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-609d1441-8811-447f-b57e-b1e9b9bccb23 req-37f2397b-229d-4f01-985d-d53294ec77ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068376 May 11 18:58:41.236479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 93/187] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:41.485107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:41.493484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-75507ec6-c935-466b-b54e-ccd7ba9aa532 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.284617 May 11 18:58:41.500678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 95/188] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:41 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:41.586259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:41.586968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:41.594343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.597293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:41.599782 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.600450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:41.846417 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:41.861508 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c74c3c59-600c-4fb7-8a05-9764b69e962d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.288187 May 11 18:58:41.875072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 94/189] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:41 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:41.887028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:41.887673 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:41.895555 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.896039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:41.896883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:41.897348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.073793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:42.087757 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ea8c2140-9d41-48b5-adbd-1e88c6e91838 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1210 microversion: 2.1 time: 0.202530 May 11 18:58:42.089100 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 96/190] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:41 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:42.387816 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:42.388392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:42.394944 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.395513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.397018 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.397341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.412735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] HTTP exception thrown: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Request method failure captured: May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 HTTP/1.1 May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAccQTVKx8H2W4Wp9Ju7fIvOKrKFpqs-jhIPuqXyug58ZNo02xET8e_-9akhelNXkmkL-BtAKvdll_cc1DtTP_NVluSQUZd6qBPx40XbDh75KEkMoxg0y9tKvzYgbfjHADI7PF-O9UPrO8xbh_6cO6mqb1E3HspLv5UzoqCpjN3iLYU May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 18:58:42.421513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2fbf31f703e849cfa03c63580dee547a", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-DeleteServersTestJSON-575555770 May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 29349dabed5746449cefe237fd3739c3 May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.422719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '6c97b0e6-b48c-4d3a-8a1d-46f124ac2316'} May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:58:42.423610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.424684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:58:42.426229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Returning 404 to user: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:58:42.426229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f121537c-9df9-42a2-a0de-0377203cd875 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 404 len: 111 microversion: 2.1 time: 0.040984 May 11 18:58:42.427585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 95/191] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 18:58:42 2022] DELETE /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:58:42.435256 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:42.435881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] [instance: 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:42.442852 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.443629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.444879 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.445386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.460130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] HTTP exception thrown: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Request method failure captured: May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 HTTP/1.1 May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAccQTVKx8H2W4Wp9Ju7fIvOKrKFpqs-jhIPuqXyug58ZNo02xET8e_-9akhelNXkmkL-BtAKvdll_cc1DtTP_NVluSQUZd6qBPx40XbDh75KEkMoxg0y9tKvzYgbfjHADI7PF-O9UPrO8xbh_6cO6mqb1E3HspLv5UzoqCpjN3iLYU May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:58:42.461593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2fbf31f703e849cfa03c63580dee547a", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2fbf31f703e849cfa03c63580dee547a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-DeleteServersTestJSON-575555770 May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 2fbf31f703e849cfa03c63580dee547a May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-DeleteServersTestJSON-575555770 May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 29349dabed5746449cefe237fd3739c3 May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-DeleteServersTestJSON-575555770-project May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.462687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '6c97b0e6-b48c-4d3a-8a1d-46f124ac2316'} May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:58:42.463321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. May 11 18:58:42.464359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:42.468520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] Returning 404 to user: Instance 6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:58:42.468520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fb2edd85-6472-4053-a984-5943370863b1 tempest-DeleteServersTestJSON-575555770 tempest-DeleteServersTestJSON-575555770-project] 10.222.0.93 "GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316" status: 404 len: 111 microversion: 2.1 time: 0.031647 May 11 18:58:42.468520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 97/192] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:42 2022] GET /compute/v2.1/servers/6c97b0e6-b48c-4d3a-8a1d-46f124ac2316 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:58:42.516374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:42.517010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:42.527157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.527653 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.528430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.528869 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.879235 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:42.879861 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:42.887523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.888142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.888738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:42.889528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:42.921166 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:42.929335 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-055a64bf-efc7-4526-bc36-920e4d77d9b3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.417092 May 11 18:58:42.929917 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 96/193] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:42 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:43.105399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:43.106521 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:43.113829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:43.114747 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:43.115577 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:43.116261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:43.207998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:43.219369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9768a507-974b-4266-b45b-f801fe4ffcf1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1272 microversion: 2.1 time: 0.117652 May 11 18:58:43.220480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 97/194] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:43 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:43.270199 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:43.278140 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-24036b9d-4090-4c1d-a88a-5322a0075913 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.402663 May 11 18:58:43.278731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 98/195] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:42 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:43.509889 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-2eb797ea-f800-4b79-b734-c3ab3b8f61e0 req-3d07803f-48ee-4d22-94c2-0851991c88d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5752ec39-bd15-4088-9f43-6acc0baf773a", "tag": "d986b82a-596f-401b-9b52-0c109271e144"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:43.523662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-2eb797ea-f800-4b79-b734-c3ab3b8f61e0 req-3d07803f-48ee-4d22-94c2-0851991c88d5 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:43.524915 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-2eb797ea-f800-4b79-b734-c3ab3b8f61e0 req-3d07803f-48ee-4d22-94c2-0851991c88d5 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:43.541366 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-2eb797ea-f800-4b79-b734-c3ab3b8f61e0 req-3d07803f-48ee-4d22-94c2-0851991c88d5 service nova] Creating event network-changed:d986b82a-596f-401b-9b52-0c109271e144 for instance 5752ec39-bd15-4088-9f43-6acc0baf773a on hv-cinder-75510 May 11 18:58:43.550095 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-2eb797ea-f800-4b79-b734-c3ab3b8f61e0 req-3d07803f-48ee-4d22-94c2-0851991c88d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045874 May 11 18:58:43.552005 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 98/196] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:43.949244 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:43.949997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:43.962380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:43.965107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:43.966048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:43.967982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:44.156913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:44.166117 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0b39ccf2-cad4-4473-8045-8db8e78ffd38 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.223206 May 11 18:58:44.166696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 99/197] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:43 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:44.239219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:44.239954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:44.246220 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:44.246971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:44.247770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:44.248365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:44.296013 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:44.296628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:44.308945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:44.309482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:44.310339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:44.310847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:44.438818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:44.446730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6ce8956d-9ef7-434e-9e09-16d80b7dcf42 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.212820 May 11 18:58:44.447333 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 99/198] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:44 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:44.452648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:44.459916 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-661f8696-307c-485f-a2db-21bde764c199 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.167986 May 11 18:58:44.460487 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 100/199] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:44 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:45.182117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:45.182751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:45.189269 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:45.189894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:45.190940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:45.192200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:45.347604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-eefc82dd-9cfb-4838-a809-26e07fb4e055 tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Action: 'create', calling method: .version_select at 0x7fa7877c8e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-573383698", "metadata": {"Type": "work"}}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:45.443229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:45.454519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ba6c9768-eacd-41d6-89aa-3ff8ccb6778f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.275993 May 11 18:58:45.473619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 100/200] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:45 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:45.484475 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:45.485532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:45.493299 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:45.494276 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:45.495224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:45.495951 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:45.734615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-eefc82dd-9cfb-4838-a809-26e07fb4e055 tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.520272 May 11 18:58:45.735425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 101/201] 10.222.0.93 () {60 vars in 1155 bytes} [Wed May 11 18:58:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 522 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 11 18:58:45.740925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:45.742139 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:45.746381 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:45.748793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:45.749462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:45.750448 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:45.751093 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:45.754960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-991fb891-11d7-47ce-af48-7500f406a7fc tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.276282 May 11 18:58:45.764452 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 101/202] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:45 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:45.771976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-692950c3-3f88-419b-95c5-4624f835e5a9 tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Calling method '.version_select at 0x7fa78c06c3a0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:45.838412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-692950c3-3f88-419b-95c5-4624f835e5a9 tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06" status: 200 len: 352 microversion: 2.1 time: 0.079299 May 11 18:58:45.839225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 102/203] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:58:45 2022] GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:45.965546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:45.975202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7dbcc8f9-ecbd-4a4f-a28d-c405625b05c8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.238280 May 11 18:58:45.976153 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 102/204] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:45 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:46.209134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-cacfa902-baa9-4c8f-b387-a5f4e9240b88 req-0c4d3dea-00bd-4f29-8a11-5874b5c4a215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46", "tag": "a7519992-a752-46cb-abcd-5162eb18eeeb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:46.221155 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-cacfa902-baa9-4c8f-b387-a5f4e9240b88 req-0c4d3dea-00bd-4f29-8a11-5874b5c4a215 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:46.221810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-cacfa902-baa9-4c8f-b387-a5f4e9240b88 req-0c4d3dea-00bd-4f29-8a11-5874b5c4a215 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:46.234164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-cacfa902-baa9-4c8f-b387-a5f4e9240b88 req-0c4d3dea-00bd-4f29-8a11-5874b5c4a215 service nova] Creating event network-changed:a7519992-a752-46cb-abcd-5162eb18eeeb for instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 on hv-cinder-75510 May 11 18:58:46.239565 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-cacfa902-baa9-4c8f-b387-a5f4e9240b88 req-0c4d3dea-00bd-4f29-8a11-5874b5c4a215 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034860 May 11 18:58:46.240184 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 103/205] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:46.474974 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:46.475594 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:46.481367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:46.481813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:46.482568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:46.483001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:46.664688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:46.672327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-98808447-4b25-4a42-be91-a995092cdaaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.202392 May 11 18:58:46.672890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 103/206] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:46 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:46.772773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:46.773472 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:46.779970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:46.780429 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:46.781205 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:46.781650 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:46.862625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4f8d99db-c00c-4e2c-8cfa-c4ea82447211 tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Calling method '.version_select at 0x7fa7877ea430>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:46.913769 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:46.915219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4f8d99db-c00c-4e2c-8cfa-c4ea82447211 tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06" status: 200 len: 353 microversion: 2.1 time: 0.056265 May 11 18:58:46.916004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 104/207] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:58:46 2022] GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:46.928357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-281af1b7-ae24-4fab-8489-54c9a567d32b tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Calling method '.version_select at 0x7fa78ca11f70>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:46.931061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-324a834d-5da3-4c32-9dcc-6ee43783e9c1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.163064 May 11 18:58:46.931706 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 104/208] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:46 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:46.979774 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-281af1b7-ae24-4fab-8489-54c9a567d32b tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06" status: 200 len: 353 microversion: 2.1 time: 0.056202 May 11 18:58:46.980441 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 105/209] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:58:46 2022] GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:46.994428 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:46.995501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:46.996914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-de43cbba-16ba-454d-842f-312bbddf0c1a tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Calling method '.version_select at 0x7fa7877da430>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:47.001987 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:47.002874 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:47.005171 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:47.005766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:47.065276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-de43cbba-16ba-454d-842f-312bbddf0c1a tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06" status: 202 len: 0 microversion: 2.1 time: 0.072210 May 11 18:58:47.066032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 106/210] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 18:58:46 2022] DELETE /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 18:58:47.076506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6ca4198d-30af-4182-b429-8f4f09526abb tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Calling method '.version_select at 0x7fa7877eae50>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:47.125061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6ca4198d-30af-4182-b429-8f4f09526abb tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06" status: 200 len: 352 microversion: 2.1 time: 0.054360 May 11 18:58:47.126074 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 107/211] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:58:47 2022] GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:58:47.155932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:47.163251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8a77238c-59e1-410e-804f-0be30f92339a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.175015 May 11 18:58:47.163868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 105/212] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:46 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:47.689391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:47.690234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:47.696747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:47.697100 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:47.698267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:47.698859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:47.827068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:47.834935 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-14dbd4de-df05-4734-997c-7e4c11168504 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.149565 May 11 18:58:47.835542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 108/213] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:47 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:47.948005 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:47.948617 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:47.955023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:47.955507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:47.956283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:47.957364 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:48.087239 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:48.095529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d15fa0d0-f98f-4bf9-bbd2-dfd5967e0879 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.151438 May 11 18:58:48.096234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 106/214] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:47 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:48.137915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e30f0c79-e6b6-4605-9085-063599732acf tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Calling method '.version_select at 0x7fa7877ea820>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:48.164126 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-e30f0c79-e6b6-4605-9085-063599732acf tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] HTTP exception thrown: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e30f0c79-e6b6-4605-9085-063599732acf tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Request method failure captured: May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 HTTP/1.1 May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAdlOBSI1sZ4Qc3Unt6d4UdOcj4WnTX0fFYYFhyZtuw0zxaf4r2sIY9JPZtf4_OYAipVS2a8tyujC8XG2K4EYlWPRvdQ3D0Myyn7dxgL1h_gCpL3SKrYZj8MRC3Op_wJeAaX1F0hcUDXPNsN2Ep0fuH79Wh81d5AVL2bkMHwM3FLPyw May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 65872cae60fe494cab25c35fcb307ae4 May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesGetTestJSON-687303230 May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:58:48.166022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/65872cae60fe494cab25c35fcb307ae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65872cae60fe494cab25c35fcb307ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_65872cae60fe494cab25c35fcb307ae4", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65872cae60fe494cab25c35fcb307ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesGetTestJSON-687303230 May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 65872cae60fe494cab25c35fcb307ae4 May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesGetTestJSON-687303230 May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesGetTestJSON-687303230-project May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: a4f43fc508604653b1c4babd2a713cc1 May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesGetTestJSON-687303230-project May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '18cf630b-d052-4580-8fd1-409e16c9db06'} May 11 18:58:48.167389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. (HTTP 404) (Request-ID: req-b1f5e8c5-b314-4f57-ba95-1e63775d24fb) May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:48.168248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 18:58:48.169443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 18:58:48.170621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e30f0c79-e6b6-4605-9085-063599732acf tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] Returning 404 to user: Volume 18cf630b-d052-4580-8fd1-409e16c9db06 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e30f0c79-e6b6-4605-9085-063599732acf tempest-VolumesGetTestJSON-687303230 tempest-VolumesGetTestJSON-687303230-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06" status: 404 len: 109 microversion: 2.1 time: 0.033420 May 11 18:58:48.171804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 109/215] 10.222.0.93 () {58 vars in 1244 bytes} [Wed May 11 18:58:48 2022] GET /compute/v2.1/os-volumes/18cf630b-d052-4580-8fd1-409e16c9db06 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:58:48.179880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:48.180491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:48.186646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:48.187090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:48.187914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:48.188342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:48.326817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:48.334886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4c5f91b2-ca3d-492c-8e43-8a9407ee8afc tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.158861 May 11 18:58:48.335496 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 107/216] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:48 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:48.852493 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:48.853337 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:48.859767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:48.860804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:48.861588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:48.862044 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:48.988810 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:48.996172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ee25fc16-9083-4ac7-8b4b-5b7297c28842 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.147596 May 11 18:58:48.996963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 110/217] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:48 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:49.112123 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:49.112738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:49.119610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:49.120066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:49.120841 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:49.121288 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:49.266766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:49.276495 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4e7a1da5-e07d-44a9-8fe9-02300691ed49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.167848 May 11 18:58:49.277414 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 108/218] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:49 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:49.351701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:49.352424 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:49.358235 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:49.358787 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:49.359648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:49.360155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:49.491875 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:49.499238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-54678665-1f6f-4d13-b797-088988ecbde8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.151947 May 11 18:58:49.499719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 111/219] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:49 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:50.013438 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:50.014048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:50.020768 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.021207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.021973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.022409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.181121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:50.188819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b07be3ad-18de-4e39-891c-376cc7d4e576 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.179374 May 11 18:58:50.189589 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 109/220] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:50 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:50.294118 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:50.294722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:50.301081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.301533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.302295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.302728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.443090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:50.452611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bc498a23-3472-470e-b7ce-c7797f2a92c2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.162089 May 11 18:58:50.453525 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 112/221] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:50 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:50.517070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:50.517689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:50.524427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.525324 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.526372 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.526820 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.665911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:50.674560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0eaa4ff0-9afc-4788-92d1-11e0dac6cc5e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.161281 May 11 18:58:50.675141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 110/222] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:50 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:50.739132 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-7c90f1f2-d630-496c-8364-4da5e188b246 req-f77489e7-537a-45e7-8e7f-a523142f7b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5752ec39-bd15-4088-9f43-6acc0baf773a", "name": "network-vif-plugged", "status": "completed", "tag": "d986b82a-596f-401b-9b52-0c109271e144"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:50.750443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7c90f1f2-d630-496c-8364-4da5e188b246 req-f77489e7-537a-45e7-8e7f-a523142f7b87 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:50.751014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7c90f1f2-d630-496c-8364-4da5e188b246 req-f77489e7-537a-45e7-8e7f-a523142f7b87 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:50.764549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-7c90f1f2-d630-496c-8364-4da5e188b246 req-f77489e7-537a-45e7-8e7f-a523142f7b87 service nova] Creating event network-vif-plugged:d986b82a-596f-401b-9b52-0c109271e144 for instance 5752ec39-bd15-4088-9f43-6acc0baf773a on hv-cinder-75510 May 11 18:58:50.770683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-7c90f1f2-d630-496c-8364-4da5e188b246 req-f77489e7-537a-45e7-8e7f-a523142f7b87 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037245 May 11 18:58:50.771970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 113/223] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:58:51.205963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:51.206637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:51.213114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:51.213557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:51.214320 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:51.214749 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:51.376929 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:51.395624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-67ac13bd-fd24-420d-8340-dd4b6a81037b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.192344 May 11 18:58:51.396220 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 111/224] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:51 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:51.475804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:51.476539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:51.482759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:51.483198 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:51.484152 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:51.484584 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:51.691433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:51.692045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:51.698693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:51.699146 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:51.700843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:51.701281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:51.709727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:51.717012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-72bb0477-041d-4fe9-8fa8-0288fb605d02 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.249894 May 11 18:58:51.717906 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 114/225] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:51 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:51.854246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:51.861435 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-60b4c310-45ce-4cc9-97ad-2f34009397b5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.173988 May 11 18:58:51.862015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 112/226] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:51 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:52.413935 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:52.414537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:52.420457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.420907 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.421664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.422088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.550887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:52.559384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-133cf262-74e2-4386-97a1-632f5d9573bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.150813 May 11 18:58:52.559967 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 115/227] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:52 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:52.734256 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:52.735035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:52.742793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.743550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.744499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.745092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.878084 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:52.879610 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:52.886523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.887248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.888983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.889641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.896116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:52.905111 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5b614d6d-b85d-4482-815a-ce44251a4124 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.174953 May 11 18:58:52.906685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 113/228] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:52 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:52.956301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-3a427c2c-148d-4e6e-844f-c9fc295625f9 req-cdeb7384-0583-4980-909d-37b0b8a92efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46", "name": "network-vif-plugged", "status": "completed", "tag": "a7519992-a752-46cb-abcd-5162eb18eeeb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:58:52.968733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-3a427c2c-148d-4e6e-844f-c9fc295625f9 req-cdeb7384-0583-4980-909d-37b0b8a92efb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:52.969726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-3a427c2c-148d-4e6e-844f-c9fc295625f9 req-cdeb7384-0583-4980-909d-37b0b8a92efb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:52.985049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-3a427c2c-148d-4e6e-844f-c9fc295625f9 req-cdeb7384-0583-4980-909d-37b0b8a92efb service nova] Creating event network-vif-plugged:a7519992-a752-46cb-abcd-5162eb18eeeb for instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 on hv-cinder-75510 May 11 18:58:52.990537 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-3a427c2c-148d-4e6e-844f-c9fc295625f9 req-cdeb7384-0583-4980-909d-37b0b8a92efb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038289 May 11 18:58:52.991983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 114/229] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:58:53.109808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:53.117040 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8fec8f28-82d6-4a75-b19e-19cc9409074f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1314 microversion: 2.1 time: 0.243034 May 11 18:58:53.117612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 116/230] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:52 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:53.578177 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:53.578880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:53.586203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:53.586666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:53.587503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:53.588071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:53.730983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:53.745313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5f5c0c4f-0571-43c6-83cc-4818a5cb3a27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.171270 May 11 18:58:53.746263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 115/231] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:53 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:53.927733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:53.928862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:53.936614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:53.937070 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:53.937843 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:53.938275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.083381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:54.091025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-589ec6cd-8a84-4db3-bf4a-a88119f347f6 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.171335 May 11 18:58:54.091630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 117/232] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:53 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:54.134230 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:54.134840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:54.141001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:54.141459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.142264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:54.142868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.282492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:54.290952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-09db5ed8-2ab2-43ab-b25c-9ef2a4ebdf86 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1499 microversion: 2.1 time: 0.160742 May 11 18:58:54.291546 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 116/233] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:54 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:54.772291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:54.773312 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:54.779986 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:54.780432 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.781373 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:54.781809 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.922700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:54.935937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4b78182d-010a-4182-a030-c120191d3bd1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.167785 May 11 18:58:54.936644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 118/234] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:54 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:54.941640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:54.942409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:54.948934 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:54.949392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.950463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:54.950908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:54.978955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 18:58:55.063121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8221a7ed-fa8c-4cbc-a3cf-3325a4f2c436 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 204 len: 0 microversion: 2.1 time: 0.125889 May 11 18:58:55.063891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 117/235] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 18:58:54 2022] DELETE /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 18:58:55.072995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:55.073598 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:55.079426 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:55.080134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:55.080644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:55.081248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:55.109682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:55.110677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:55.120305 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:55.121094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:55.122351 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:55.122972 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:55.230418 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:55.238368 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6175400b-0fd9-4fe8-acab-b028db838c36 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.169197 May 11 18:58:55.238949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 119/236] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:55 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:55.265072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:55.272407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2d81bd4a-5068-4383-b1f9-4b3a0db6f320 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.167628 May 11 18:58:55.273062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 118/237] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:55 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:55.954802 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:55.956119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:55.963452 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:55.963902 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:55.964669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:55.965096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:56.101148 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:56.108803 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6b4ebec4-001f-4ba0-b41c-bfca03bd3494 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.158155 May 11 18:58:56.109386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 120/238] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:55 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:56.256073 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:56.256682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:56.263129 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:56.263626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:56.264430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:56.264912 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:56.289969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:56.290578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:56.296400 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:56.296852 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:56.297648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:56.298093 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:56.395108 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:56.415796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-38753795-fcf4-434b-8363-49bcd1f1bffd tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.163890 May 11 18:58:56.416632 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 119/239] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:56 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:56.436206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:56.443949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4aba290a-98f4-49f3-83db-2b0805da9b49 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1314 microversion: 2.1 time: 0.157784 May 11 18:58:56.444778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 121/240] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:56 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:57.125783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:57.126302 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:57.132286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.132735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.133498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.133941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.272329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:57.279685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0878f0cc-b26c-4a93-b9ef-c2466fa4d458 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.157893 May 11 18:58:57.280262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 120/241] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:57 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:57.432701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:57.433301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:57.439716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.440173 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.441124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.441563 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.462195 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:57.463002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:57.469717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.470171 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.470951 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.471421 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.584530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:57.591792 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-addb0f46-4e2d-4af7-8524-dd4bf842f10e tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.162939 May 11 18:58:57.592558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 122/242] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:57 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:57.602374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:57.609770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0af28975-ae1a-48a5-9ba9-d3da11528ac2 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1463 microversion: 2.1 time: 0.152149 May 11 18:58:57.610334 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 121/243] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:57 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:57.650478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:57.650968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:57.656812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.657257 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.658011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.658443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.683147 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 18:58:57.771286 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8bd74d7e-c771-4db7-b973-d512c9d8e789 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 204 len: 0 microversion: 2.1 time: 0.124313 May 11 18:58:57.771893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 123/244] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 18:58:57 2022] DELETE /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 18:58:57.780271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:57.781126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:57.792483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.792939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.793775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:57.794183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:57.933917 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:57.942250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-12403c50-8ed5-4878-a5c7-637bbb0aafdf tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.165981 May 11 18:58:57.942822 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 122/245] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:57 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:58:58.297960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:58.298660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:58.311419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:58.312306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:58.312855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:58.313419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:58.445434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:58.452813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-514912cb-83ad-48a5-a386-2c2d0190309b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.159179 May 11 18:58:58.453386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 124/246] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:58 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:58.609479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:58.610089 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:58.617145 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:58.617601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:58.618369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:58.618819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:58.747150 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:58.754495 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2f7afccb-1882-4d66-ab9f-fa7a988bfaa6 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.148951 May 11 18:58:58.755059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 123/247] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:58 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:58.960366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:58.961001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:58.967007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:58.967488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:58.968247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:58.968680 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:59.096676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:59.104513 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9d90e6d3-9d65-4b11-801c-0b397ef0fa27 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.148474 May 11 18:58:59.105085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 125/248] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:58 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:59.470066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:59.470727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:59.477578 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:59.478026 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:59.478801 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:59.479240 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:59.605611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:59.613972 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-754d9588-1b34-4844-8b52-32fc0e6f0a12 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.148007 May 11 18:58:59.614561 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 124/249] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:59 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:58:59.770546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:58:59.771144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:58:59.777151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:59.777626 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:59.778380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:58:59.778812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:58:59.904499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:58:59.911767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7ac11b5e-b088-46a7-a1b8-700b3dc097b2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.144993 May 11 18:58:59.912328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 126/250] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:58:59 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:00.121544 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:00.122055 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:00.128403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:00.128848 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:00.129706 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:00.130145 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:00.257012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:00.264341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-707a31f4-9c52-4cdf-9843-fb9b52983551 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.146702 May 11 18:59:00.264940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 125/251] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:00 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:00.630536 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:00.631142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:00.637104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:00.637547 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:00.638305 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:00.638742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:00.762392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:00.770190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-31c7b8ec-4834-469e-a1aa-938d2785b86b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.143435 May 11 18:59:00.770748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 127/252] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:00 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:00.928790 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:00.929399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:00.935335 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:00.935794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:00.936559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:00.937003 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:01.060717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:01.068671 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-41e509b2-a7f2-4676-8e20-40c2f9a055ca tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.143787 May 11 18:59:01.069497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 126/253] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:00 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:01.280790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:01.281391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:01.287402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:01.287850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:01.288606 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:01.289038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:01.422833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:01.430551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-03f6ad8b-4d74-432e-b240-46a0d007ffe1 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.153657 May 11 18:59:01.431110 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 128/254] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:01 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:01.786786 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:01.787415 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:01.793715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:01.794168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:01.794935 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:01.795403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:01.922896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:01.930276 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-03c361b3-07f1-4863-82b7-5c13a38c4cbb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.147858 May 11 18:59:01.930903 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 127/255] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:01 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:02.086298 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:02.086905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:02.093012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.093460 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:02.094224 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.094655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:02.226752 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:02.234002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-76915317-dc4e-4b9b-9b7c-b05f97aa6d82 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.151641 May 11 18:59:02.234565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 129/256] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:02 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:02.447737 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:02.448425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:02.454344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.454797 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:02.455590 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.456029 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:02.585538 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:02.592976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e6a447c7-8835-4bea-9872-8b0b9e87dcb4 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.149465 May 11 18:59:02.593554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 128/257] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:02 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:02.765501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-393ad23b-09d5-41aa-a8b8-ba81f8b59593 req-b177bfeb-a709-43ae-972a-39875607a738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5752ec39-bd15-4088-9f43-6acc0baf773a", "name": "network-vif-unplugged", "status": "completed", "tag": "d986b82a-596f-401b-9b52-0c109271e144"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:02.773797 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-393ad23b-09d5-41aa-a8b8-ba81f8b59593 req-b177bfeb-a709-43ae-972a-39875607a738 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.774318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-393ad23b-09d5-41aa-a8b8-ba81f8b59593 req-b177bfeb-a709-43ae-972a-39875607a738 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:02.787225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-393ad23b-09d5-41aa-a8b8-ba81f8b59593 req-b177bfeb-a709-43ae-972a-39875607a738 service nova] Creating event network-vif-unplugged:d986b82a-596f-401b-9b52-0c109271e144 for instance 5752ec39-bd15-4088-9f43-6acc0baf773a on hv-cinder-75510 May 11 18:59:02.792242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-393ad23b-09d5-41aa-a8b8-ba81f8b59593 req-b177bfeb-a709-43ae-972a-39875607a738 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030418 May 11 18:59:02.793063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 130/258] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:02.948109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:02.948721 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:02.955085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.955581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:02.956361 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:02.956792 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:03.084965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:03.092593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a138b810-7d6d-4513-b0b7-ff20d113c013 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.148580 May 11 18:59:03.093174 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 129/259] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:02 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:03.252456 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:03.253151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:03.259175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:03.259657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:03.260421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:03.260966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:03.609780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:03.610399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:03.616214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:03.616664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:03.617436 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:03.617875 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:03.699856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:03.707897 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-de28ece4-2d9e-4aa1-aff7-03442eb713de tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1505 microversion: 2.1 time: 0.460246 May 11 18:59:03.717310 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 131/260] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:03 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:03.755954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:03.770334 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0cc3985a-7220-44a2-9c6a-6c1ab681d219 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.163219 May 11 18:59:03.771354 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 130/261] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:03 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:03.920113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-ed596eab-9835-4427-a3ec-9ffb16da76ea req-53558dc7-eabf-4afe-84bd-a427c0a89fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5752ec39-bd15-4088-9f43-6acc0baf773a", "name": "network-vif-deleted", "tag": "d986b82a-596f-401b-9b52-0c109271e144"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:03.927958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-ed596eab-9835-4427-a3ec-9ffb16da76ea req-53558dc7-eabf-4afe-84bd-a427c0a89fff service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:03.928398 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-ed596eab-9835-4427-a3ec-9ffb16da76ea req-53558dc7-eabf-4afe-84bd-a427c0a89fff service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:03.939007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-ed596eab-9835-4427-a3ec-9ffb16da76ea req-53558dc7-eabf-4afe-84bd-a427c0a89fff service nova] Creating event network-vif-deleted:d986b82a-596f-401b-9b52-0c109271e144 for instance 5752ec39-bd15-4088-9f43-6acc0baf773a on hv-cinder-75510 May 11 18:59:03.944731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-ed596eab-9835-4427-a3ec-9ffb16da76ea req-53558dc7-eabf-4afe-84bd-a427c0a89fff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027946 May 11 18:59:03.945303 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 132/262] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:04.109764 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:04.110370 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:04.117188 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:04.117639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:04.118401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:04.118834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:04.243398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:04.250600 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7f65726f-60b9-4611-a9e4-71e9f7c22b19 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.144687 May 11 18:59:04.251266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 131/263] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:04 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:04.725727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:04.726425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:04.732634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:04.733085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:04.733848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:04.734291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:04.788476 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:04.789136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:04.795004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:04.795380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:04.795532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:04.796243 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:04.796669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:04.803587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-78ac2a8f-b2a3-45b5-b1ef-7be9782420ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1463 microversion: 2.1 time: 0.082556 May 11 18:59:04.804160 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 133/264] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:04 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1463 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:04.927988 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:04.935237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1a9bdbac-2791-49c4-a2ca-e4ae90382817 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1469 microversion: 2.1 time: 0.151301 May 11 18:59:04.935817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 132/265] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:04 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:05.268487 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:05.269671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:05.275703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.276180 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.276925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.277366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.403745 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:05.411047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7392e263-f832-40e3-b1f7-b26fc6475119 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.146571 May 11 18:59:05.411671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 134/266] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:05 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:05.821439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:05.823035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:05.829458 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.829918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.830670 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.831103 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.860477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.860918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.861352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lazy-loading 'fault' on Instance uuid 5752ec39-bd15-4088-9f43-6acc0baf773a {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:59:05.906288 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:05.914446 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0d5aa2c1-e986-4997-aed7-937a1e1a38f5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 200 len: 1304 microversion: 2.1 time: 0.097055 May 11 18:59:05.915380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 133/267] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:05 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:05.952528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:05.953113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:05.959183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.960790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.961570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.962365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.968780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-03c4650a-6a08-4ba8-b8c2-f96d2b629594 req-18e65f6d-495e-4d83-a2ee-9dcf68f374da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46", "name": "network-vif-deleted", "tag": "a7519992-a752-46cb-abcd-5162eb18eeeb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:05.978968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-03c4650a-6a08-4ba8-b8c2-f96d2b629594 req-18e65f6d-495e-4d83-a2ee-9dcf68f374da service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:05.979441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-03c4650a-6a08-4ba8-b8c2-f96d2b629594 req-18e65f6d-495e-4d83-a2ee-9dcf68f374da service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:05.991951 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-03c4650a-6a08-4ba8-b8c2-f96d2b629594 req-18e65f6d-495e-4d83-a2ee-9dcf68f374da service nova] Creating event network-vif-deleted:a7519992-a752-46cb-abcd-5162eb18eeeb for instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 on hv-cinder-75510 May 11 18:59:05.997071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-03c4650a-6a08-4ba8-b8c2-f96d2b629594 req-18e65f6d-495e-4d83-a2ee-9dcf68f374da service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033875 May 11 18:59:05.998000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 134/268] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:59:06.032785 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:06.041962 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1606faa8-2436-4e74-a216-c48e97f23c18 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1427 microversion: 2.1 time: 0.093259 May 11 18:59:06.042660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 135/269] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:05 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:06.428593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:06.429292 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:06.435451 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:06.435908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:06.436679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:06.437142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:06.571694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:06.579786 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7735ce8d-5bd8-4285-b290-1681b0d53b65 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1522 microversion: 2.1 time: 0.155338 May 11 18:59:06.580369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 135/270] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:06 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:06.931049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:06.931707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 5752ec39-bd15-4088-9f43-6acc0baf773a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:06.937530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:06.937977 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:06.938742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:06.939178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:06.953549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] HTTP exception thrown: Instance 5752ec39-bd15-4088-9f43-6acc0baf773a could not be found. May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Request method failure captured: May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a HTTP/1.1 May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAdWo_p0aA3ZtcghY1Vj-1BBinw9m1_-0wtDd65WhvPtLmArOq1Gn0_SMJsTvKQrq5tqbFS5DndnUeL70cUZQonvCxzQk4rebVemkAb_JGbifNonr0ztSXAFLZc3oy4As-ndo4KVdEqFaNypbY0lhhBrQAX1DXymRMKJxvLlCnqU6hA May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 335338c6d5e740d0b388702462e552ef May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesActionsTest-854584466 May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:59:06.955255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/335338c6d5e740d0b388702462e552ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/335338c6d5e740d0b388702462e552ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_335338c6d5e740d0b388702462e552ef", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/335338c6d5e740d0b388702462e552ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesActionsTest-854584466 May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 335338c6d5e740d0b388702462e552ef May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesActionsTest-854584466 May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesActionsTest-854584466-project May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 04109028620d4b7284fbd32efc695c56 May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesActionsTest-854584466-project May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 5752ec39-bd15-4088-9f43-6acc0baf773a could not be found. May 11 18:59:06.956508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '5752ec39-bd15-4088-9f43-6acc0baf773a'} May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5752ec39-bd15-4088-9f43-6acc0baf773a could not be found. May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:59:06.957239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5752ec39-bd15-4088-9f43-6acc0baf773a could not be found. May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5752ec39-bd15-4088-9f43-6acc0baf773a could not be found. May 11 18:59:06.959491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:06.960735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Returning 404 to user: Instance 5752ec39-bd15-4088-9f43-6acc0baf773a could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:59:06.960735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-92c7ee78-af5a-4f21-9356-427b0fd05479 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a" status: 404 len: 111 microversion: 2.1 time: 0.029674 May 11 18:59:06.960735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 136/271] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:06 2022] GET /compute/v2.1/servers/5752ec39-bd15-4088-9f43-6acc0baf773a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 18:59:07.055767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1167775276", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "networks": [{"uuid": "95df4839-1eaa-4a99-b24c-59375c2425ed"}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:07.060779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:07.061386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:07.067739 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.068183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.068939 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.069626 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.101340 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.101790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.102246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lazy-loading 'fault' on Instance uuid c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:59:07.106377 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] validate_networks() for [('95df4839-1eaa-4a99-b24c-59375c2425ed', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:59:07.148429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:07.155624 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-49d14ac4-7419-4a9a-9c47-3bf34fe8f926 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1304 microversion: 2.1 time: 0.098653 May 11 18:59:07.156194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 137/272] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:07 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:07.458597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:59:07.459031 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:59:07.459604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:59:07.459966 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:59:07.460380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:59:07.470455 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.470915 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.471750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.472189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.491371 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Getting quotas for project 335338c6d5e740d0b388702462e552ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:07.495409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Getting quotas for user 04109028620d4b7284fbd32efc695c56 and project 335338c6d5e740d0b388702462e552ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:07.506323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:59:07.508677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:59:07.553535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fc1986b1-affc-414e-b73e-3e95bb526624 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502752 May 11 18:59:07.554226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 136/273] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:59:07.564068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2937c6ed-5549-416f-970d-2470dde420fe tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:07.564678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2937c6ed-5549-416f-970d-2470dde420fe tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:07.597288 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:07.598459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:07.605264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.605713 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.606487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.606925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.620533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2937c6ed-5549-416f-970d-2470dde420fe tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:07.627929 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2937c6ed-5549-416f-970d-2470dde420fe tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1214 microversion: 2.1 time: 0.067645 May 11 18:59:07.637568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 138/274] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:07 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:07.767563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:07.777295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-502f8adb-9941-4d33-b521-664c4fe48412 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1502 microversion: 2.1 time: 0.183691 May 11 18:59:07.778199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 137/275] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:07 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:07.796973 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:07.797656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:07.806776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.807630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:07.808696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:07.809597 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:08.010369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:08.019090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3ce1df3a-37b3-4e1c-bcae-f165fdbd5d40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1516 microversion: 2.1 time: 0.227623 May 11 18:59:08.032601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 139/276] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:07 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:08.173338 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:08.174749 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:08.182110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:08.182964 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:08.183840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:08.184359 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:08.221316 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:08.221686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:08.222120 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lazy-loading 'fault' on Instance uuid c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:59:08.270374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522fa28726b4abbbc022de1c37fee11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ef1c88946b43a4a38adb2597263432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:08.279064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a019d2cc-0229-4886-aa0f-f8b58fd9aaf5 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 200 len: 1304 microversion: 2.1 time: 0.109387 May 11 18:59:08.291106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 138/277] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:08 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:08.644805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:08.645308 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:08.651222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:08.651692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:08.652447 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:08.652880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:08.714837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:08.722345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-dce6b820-9db0-42dd-88b4-3e5dde53b785 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1266 microversion: 2.1 time: 0.081568 May 11 18:59:08.722940 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 140/278] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:08 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:09.299323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:09.300069 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] [instance: c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:09.307935 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.308981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.310056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.310751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.330821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] HTTP exception thrown: Instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 could not be found. May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Request method failure captured: May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 HTTP/1.1 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAdd-0JfaTARcgNS2XExMTVcChCAl8V9eEXoOUTgo_9p2RE4W_7HIyIqnKDHCA8UjeEYdNKP2oAW6IOeHJGXsW_La51VHyrIwR5fLJ3GxcZ47H2hFF38UtC_eyUqgxecwrdi9GlOOs1lAPRXLoXZnjAfKoAE8X_-5iraAMty4y-fj18 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: c6ef1c88946b43a4a38adb2597263432 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-VolumesNegativeTest-1689150880 May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 18:59:09.333439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c6ef1c88946b43a4a38adb2597263432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6ef1c88946b43a4a38adb2597263432"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c6ef1c88946b43a4a38adb2597263432", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6ef1c88946b43a4a38adb2597263432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-VolumesNegativeTest-1689150880 May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: c6ef1c88946b43a4a38adb2597263432 May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-VolumesNegativeTest-1689150880 May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-VolumesNegativeTest-1689150880-project May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 8522fa28726b4abbbc022de1c37fee11 May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-VolumesNegativeTest-1689150880-project May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 could not be found. May 11 18:59:09.334572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46'} May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 could not be found. May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:59:09.335352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 could not be found. May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 could not be found. May 11 18:59:09.336368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 18:59:09.338690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] Returning 404 to user: Instance c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:59:09.339982 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3676a0cf-9716-4c56-af6f-4a9b09cfa274 tempest-VolumesNegativeTest-1689150880 tempest-VolumesNegativeTest-1689150880-project] 10.222.0.93 "GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46" status: 404 len: 111 microversion: 2.1 time: 0.044477 May 11 18:59:09.341931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 139/279] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:09 2022] GET /compute/v2.1/servers/c3b8d0cd-64dd-4d8f-ad59-e8dd4e2ede46 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:59:09.455942 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:09.458469 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:09.465830 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.466608 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.467790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.468409 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.665124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'flavor' on Instance uuid b57bf0b3-ec26-4008-9534-60b21519c99c {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:59:09.738664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:09.739180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:09.752375 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.752859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.753652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.754641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.855928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8a80ae61-a2eb-45ad-af93-ac4d82e58b30 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/action" status: 200 len: 32 microversion: 2.1 time: 0.404280 May 11 18:59:09.860694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 141/280] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 18:59:09 2022] POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 18:59:09.867798 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:09.870044 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:09.878298 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.879494 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.880459 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:09.881236 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:09.921116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:09.930810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bfc84396-72fa-477e-9805-6dff3ecbc96d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1272 microversion: 2.1 time: 0.195991 May 11 18:59:09.933038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 140/281] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:09 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:10.128564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:10.141470 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-11a3b050-8029-46e4-8285-39691f697980 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.278934 May 11 18:59:10.144210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 142/282] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:09 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:10.961605 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:10.962149 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:10.972687 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:10.973357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:10.975897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:10.976542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:11.119488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-115459f2-a7ac-4c4b-914b-7a80090f3de4 req-1a9df60d-2869-4a31-9df6-9e927e18c471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "501f1b0d-527c-42b0-809d-bae422c7e56e", "tag": "29cb5d2e-d91e-40ec-8e12-5583f21e9afd"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:11.150095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-115459f2-a7ac-4c4b-914b-7a80090f3de4 req-1a9df60d-2869-4a31-9df6-9e927e18c471 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:11.150736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-115459f2-a7ac-4c4b-914b-7a80090f3de4 req-1a9df60d-2869-4a31-9df6-9e927e18c471 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:11.169632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-115459f2-a7ac-4c4b-914b-7a80090f3de4 req-1a9df60d-2869-4a31-9df6-9e927e18c471 service nova] Creating event network-changed:29cb5d2e-d91e-40ec-8e12-5583f21e9afd for instance 501f1b0d-527c-42b0-809d-bae422c7e56e on hv-cinder-75510 May 11 18:59:11.176655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-115459f2-a7ac-4c4b-914b-7a80090f3de4 req-1a9df60d-2869-4a31-9df6-9e927e18c471 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062953 May 11 18:59:11.177290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 143/283] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:11.184628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:11.185975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:11.194794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:11.202413 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:11.202963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:11.211840 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:11.212522 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:11.213200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-001f1f50-c0da-4c52-812d-67065c808851 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.266733 May 11 18:59:11.213786 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 141/284] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:10 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:11.458998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:11.467484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-33225d57-7f57-4c83-b54d-c0b1ad4a89d6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.288745 May 11 18:59:11.468381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 144/285] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:11 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:12.230811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:12.231511 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:12.238178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:12.238901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:12.240052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:12.240812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:12.401295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:12.410033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6919d87d-4cc6-4f7e-85ed-d079d22013ac tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.183128 May 11 18:59:12.410648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 142/286] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:12 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:12.486693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:12.487486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:12.494084 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:12.494630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:12.495437 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:12.495995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:12.656536 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:12.666599 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-05af8d1e-d5bf-442e-9fb2-358f6bb207ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.184482 May 11 18:59:12.667426 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 145/287] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:12 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:13.430507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:13.432140 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:13.444747 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:13.445318 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:13.446192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:13.446783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:13.596428 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:13.603558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3371076e-fc0c-4ec1-8632-8c30498212a8 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.180528 May 11 18:59:13.604118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 143/288] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:13 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:13.687926 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:13.688579 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:13.695153 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:13.695638 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:13.696406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:13.696845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:13.823654 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:13.831470 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7ef67ac0-a799-4383-90fa-a8c057bdad43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.147344 May 11 18:59:13.831975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 146/289] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:13 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:14.620803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:14.621997 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:14.632042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:14.632393 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:14.633356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:14.633797 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:14.821707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:14.831798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5b0c757f-198a-48e3-91fd-5d8a80b5a46f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.214849 May 11 18:59:14.833881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 144/290] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:14 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:14.853153 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:14.853153 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:14.857003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:14.858036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:14.859461 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:14.860150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:15.007397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:15.014680 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-910cb98c-e0fb-4b35-9a50-fedda55ea6b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.169527 May 11 18:59:15.015401 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 147/291] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:14 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:15.850718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:15.851341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:15.857813 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:15.858255 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:15.859010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:15.859480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:15.994266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:16.001703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7ae29e51-10cf-4154-bb3e-1e516357c926 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.155627 May 11 18:59:16.002284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 145/292] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:15 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:16.032684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:16.033391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:16.040225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:16.040669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:16.041629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:16.042046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:16.213744 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:16.222224 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a1867de3-ed3a-43ea-accb-f03f702febe1 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.193652 May 11 18:59:16.223698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 148/293] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:16 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:16.939151 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-cfa81b29-ee2c-48ff-aef7-dd36e00fbd24 req-d9ee98fd-0c23-4bcc-a9bc-8e90528b5ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501f1b0d-527c-42b0-809d-bae422c7e56e", "name": "network-vif-plugged", "status": "completed", "tag": "29cb5d2e-d91e-40ec-8e12-5583f21e9afd"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:16.948716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-cfa81b29-ee2c-48ff-aef7-dd36e00fbd24 req-d9ee98fd-0c23-4bcc-a9bc-8e90528b5ee1 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:16.949374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-cfa81b29-ee2c-48ff-aef7-dd36e00fbd24 req-d9ee98fd-0c23-4bcc-a9bc-8e90528b5ee1 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:16.964370 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-cfa81b29-ee2c-48ff-aef7-dd36e00fbd24 req-d9ee98fd-0c23-4bcc-a9bc-8e90528b5ee1 service nova] Creating event network-vif-plugged:29cb5d2e-d91e-40ec-8e12-5583f21e9afd for instance 501f1b0d-527c-42b0-809d-bae422c7e56e on hv-cinder-75510 May 11 18:59:16.969986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-cfa81b29-ee2c-48ff-aef7-dd36e00fbd24 req-d9ee98fd-0c23-4bcc-a9bc-8e90528b5ee1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034241 May 11 18:59:16.970582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 146/294] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:17.018358 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:17.019168 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:17.037299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:17.038537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:17.038537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:17.038960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:17.242555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:17.243689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:17.255535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:17.255866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:17.256652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:17.261430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:17.456066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:17.464157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8fd408e5-8aea-4be7-b260-c357efbfeae7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.227086 May 11 18:59:17.464965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 147/295] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:17 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:17.651460 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:17.658981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5003ba7d-8b04-45b4-b98e-fbe53aa4cf08 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.644741 May 11 18:59:17.661482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 149/296] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:17 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:18.482161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:18.482777 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:18.490672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:18.491261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:18.492161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:18.492695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:18.640582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:18.649303 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-85c27637-2213-4d8f-8a19-ea3ec13f9c7f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.171126 May 11 18:59:18.650110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 148/297] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:18 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:18.677775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:18.678378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:18.706150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:18.706733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:18.708189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:18.708637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:18.924870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:18.935178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-83850988-38e0-4b32-b3ff-2ec83c9026df tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.261130 May 11 18:59:18.947558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 150/298] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:18 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:19.666080 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:19.667486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:19.673969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:19.674424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:19.675191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:19.675645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:19.944058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:19.952172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:19.952899 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:19.953919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-eea2efc4-b17c-437f-85e8-ed5f0f44f7e2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.291700 May 11 18:59:19.954501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 149/299] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:19 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:19.960484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:19.960941 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:19.962187 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:19.962845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:20.120819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:20.131854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-49d26718-d592-4453-9a1d-c80d3f1c6a8f tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.183491 May 11 18:59:20.134041 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 151/300] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:19 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:20.974294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:20.975777 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:20.983398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:20.984226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:20.985326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:20.985949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:21.150650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:21.151465 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:21.156603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:21.157767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:21.158460 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:21.159603 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:21.160834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:21.164502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5c46d1d9-bf0f-4e1c-9b46-490f29e3a271 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.196110 May 11 18:59:21.165083 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 150/301] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:20 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:21.318698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:21.326285 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-16b2bbe3-314c-4956-9a17-6af2cc5e256a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.179677 May 11 18:59:21.326850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 152/302] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:21 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:22.182118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:22.183333 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:22.197501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:22.198296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:22.199085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:22.199723 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:22.345048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:22.346327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:22.353385 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:22.354267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:22.355260 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:22.355975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:22.545450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:22.551375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:22.556896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-85b2f4ac-7ee3-4004-ac82-1f9ae5713eab tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.379148 May 11 18:59:22.557916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 151/303] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:22 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:22.564182 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8b2adda7-780f-43a2-95f5-97d1ac3be840 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.223644 May 11 18:59:22.565540 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 153/304] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:22 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:23.574476 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:23.576519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:23.581320 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:23.582500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:23.583932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:23.584599 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:23.585465 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:23.586137 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:23.588991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:23.589663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:23.590633 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:23.591332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:23.775053 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:23.785657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f2c24411-4ba1-4b96-a03d-11fcc12fb010 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.207400 May 11 18:59:23.786348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 154/305] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:23 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:23.926725 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:23.966023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e8f38f61-0fe4-4967-a81b-5f9d771f7939 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.395501 May 11 18:59:23.975844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 152/306] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:23 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:24.809531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:24.810297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:24.825692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:24.826683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:24.829647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:24.830354 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:24.984655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:24.985392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:24.999977 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:25.002907 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:25.004452 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:25.004996 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:25.189865 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:25.200862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-49fb3949-24a2-4dbb-ad2d-423fe4140d11 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1314 microversion: 2.1 time: 0.402319 May 11 18:59:25.204005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 155/307] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:24 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:25.277543 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:25.286437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-63e8a31f-b0b4-4bdc-894a-2e1d1d9663f8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.306332 May 11 18:59:25.287642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 153/308] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:24 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:26.224745 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:26.226719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:26.276657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:26.277462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:26.280002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:26.280770 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:26.304574 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:26.308036 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:26.340155 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:26.342106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:26.343115 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:26.346512 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:26.630011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:26.653763 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2906c54e-0482-44bb-ab55-e5dbf33130ba tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1498 microversion: 2.1 time: 0.434756 May 11 18:59:26.655740 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 156/309] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:26 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:26.850361 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:26.864246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-efa8cc30-6d39-48bd-bb6c-4d674aef0d3d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.562699 May 11 18:59:26.869724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 154/310] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:26 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:27.497833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:27.498661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:27.508829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:27.509207 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:27.509993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:27.510424 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:27.571288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 18:59:27.724979 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bbbf34bc-c3df-4094-85d8-cb6250d8551d tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "DELETE /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 204 len: 0 microversion: 2.1 time: 0.230794 May 11 18:59:27.725776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 157/311] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 18:59:27 2022] DELETE /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 18:59:27.735239 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:27.740429 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:27.748074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:27.748612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:27.749597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:27.750244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:27.882694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:27.883440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:27.893880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:27.898286 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:27.902503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:27.904655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:27.986090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:27.997065 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e02a8175-a070-42e1-93b7-1015ab0d4b19 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1504 microversion: 2.1 time: 0.263110 May 11 18:59:27.998313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 155/312] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:27 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:28.238736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:28.239564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:28.244116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:28.254385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:28.254846 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:28.255139 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-82a47537-ff4b-44d7-ab67-6b93bdd4cd60 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.377469 May 11 18:59:28.255744 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 158/313] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:27 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:28.264650 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:28.264893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:28.312825 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-08d21280-4c42-4e46-a5da-411ca3b36450 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/ips" status: 200 len: 150 microversion: 2.20 time: 0.080842 May 11 18:59:28.313405 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 156/314] 10.222.0.93 () {60 vars in 1288 bytes} [Wed May 11 18:59:28 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 18:59:28.883666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8a5dd2db-a270-4a3c-900b-42329dd22ce0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Action: 'create', calling method: .version_select at 0x7fa7877b6ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-203305523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrJ8P+btIq5qv2HaQfS3eyJjg3+bLb3Di8UJ31idHaC0XAtSowKff39KLySOSBUVFuSrGzM5cSr5T/ivViIfWnWXvUbT3GktIruA5P/uHxI2/mZ5rXww989nqueZQDGZg=="}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:28.916528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-8a5dd2db-a270-4a3c-900b-42329dd22ce0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Getting quotas for project 7d1d877d09894265a3ecb65f70684a29. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:28.921096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-8a5dd2db-a270-4a3c-900b-42329dd22ce0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Getting quotas for user 521ce300deaf4ebba282688e5b8fa394 and project 7d1d877d09894265a3ecb65f70684a29. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:28.975060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8a5dd2db-a270-4a3c-900b-42329dd22ce0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.420906 May 11 18:59:28.975745 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 159/315] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 18:59:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:29.024796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:29.028232 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:29.039831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:29.040310 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:29.041193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:29.042258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:29.273937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:29.276002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:29.288318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:29.289716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:29.296385 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:29.297729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:29.298330 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:29.301179 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6e835cee-2d04-4474-8dd6-3507b58f97c5 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1504 microversion: 2.1 time: 0.286920 May 11 18:59:29.301958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 157/316] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:29 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:29.526631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:29.536513 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9adef1c5-a2b5-45ca-be1a-81722f8924dd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.268796 May 11 18:59:29.538577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 160/317] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:29 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:30.322631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:30.323445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:30.336860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:30.339651 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:30.341971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:30.343052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:30.554521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:30.555231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:30.561434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:30.568551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:30.570964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:30.571672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:30.898703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:30.908126 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-52d66cba-15b7-43af-a1c6-23932ac0f750 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.358029 May 11 18:59:30.908728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 161/318] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:30 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:30.989628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:30.990520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:30.997781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:30.998403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:30.999405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:31.000013 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:31.042632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lazy-loading 'flavor' on Instance uuid 03cc433d-eca3-41fe-9a3a-45e94cd562fd {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:59:31.220610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:31.232301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e985e654-f756-490e-b179-c46f1f80bfb2 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1504 microversion: 2.1 time: 0.915980 May 11 18:59:31.234501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 158/319] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:30 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1504 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:31.526751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3d75bb81-941e-4b46-8043-0970101d01eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/action" status: 202 len: 0 microversion: 2.20 time: 0.541089 May 11 18:59:31.528488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 162/320] 10.222.0.93 () {62 vars in 1318 bytes} [Wed May 11 18:59:30 2022] POST /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 18:59:31.543417 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:31.545459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:31.557320 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:31.558538 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:31.559661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:31.561644 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:31.849466 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:31.868638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:31.870527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:31.872225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a7c348f5-9f95-42c0-9915-a854fc585c96 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.339900 May 11 18:59:31.874770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 159/321] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:31 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:59:31.928302 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:31.929156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:31.943184 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:31.944682 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:31.948839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:31.949333 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:32.252873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:32.255142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:32.271685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:32.272139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:32.272971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:32.273459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:32.429933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:32.443808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9468c947-7d38-44ec-9bae-655597f4b06e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.521004 May 11 18:59:32.447651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 163/322] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:31 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:32.741292 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:32.750409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-82fee31f-98c4-4131-bc38-13ed69dfbad3 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1504 microversion: 2.1 time: 0.502761 May 11 18:59:32.763199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 160/323] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:32 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:32.840240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-7cc90a23-d8d6-4fb2-b606-1f13d99caa4a req-53de76a8-0e19-4e4a-9744-0fb3d09f478f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501f1b0d-527c-42b0-809d-bae422c7e56e", "name": "network-vif-deleted", "tag": "29cb5d2e-d91e-40ec-8e12-5583f21e9afd"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:32.854733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7cc90a23-d8d6-4fb2-b606-1f13d99caa4a req-53de76a8-0e19-4e4a-9744-0fb3d09f478f service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:32.856002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7cc90a23-d8d6-4fb2-b606-1f13d99caa4a req-53de76a8-0e19-4e4a-9744-0fb3d09f478f service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:32.879396 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-7cc90a23-d8d6-4fb2-b606-1f13d99caa4a req-53de76a8-0e19-4e4a-9744-0fb3d09f478f service nova] Creating event network-vif-deleted:29cb5d2e-d91e-40ec-8e12-5583f21e9afd for instance 501f1b0d-527c-42b0-809d-bae422c7e56e on hv-cinder-75510 May 11 18:59:32.892330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:32.893148 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:32.905812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:32.906363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:32.907234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:32.910389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:32.912205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-7cc90a23-d8d6-4fb2-b606-1f13d99caa4a req-53de76a8-0e19-4e4a-9744-0fb3d09f478f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075515 May 11 18:59:32.919136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 164/324] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:33.171200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:33.179954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:33.181707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:33.183058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4ece4ae5-5c6b-4d67-ae7d-20e3f6c7226b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.294917 May 11 18:59:33.183830 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 161/325] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:32 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:59:33.465280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:33.467324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:33.485071 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:33.485857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:33.486812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:33.488059 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:33.709131 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:33.724017 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3e62c4eb-807d-41e8-9da3-23cd41a756a4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.265086 May 11 18:59:33.724905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 165/326] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:33 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:33.774938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:33.776157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:33.782735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:33.783007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:33.783952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:33.784562 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:33.868917 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:33.878088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-09d0bba8-885d-483d-9f51-fdf384006e45 tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1462 microversion: 2.1 time: 0.107375 May 11 18:59:33.879224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 162/327] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:33 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:34.213936 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:34.214789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:34.222892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:34.223416 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:34.224206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:34.224760 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:34.447805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:34.458651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:34.460675 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:34.462124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6f65bcc3-4b72-4a5d-bd40-21d20fa3c3bb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.264404 May 11 18:59:34.462778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 166/328] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:34 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:34.748116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:34.749045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:34.760782 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:34.761241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:34.762028 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:34.762468 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:34.896713 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:34.897897 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:34.906403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:34.907012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:34.907915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:34.908568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:34.936134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:34.949077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-73d45fd9-5352-4358-a235-83e240e516be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.205132 May 11 18:59:34.959851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 163/329] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:34 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:34.979891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:34.988729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-60626a44-24d2-4983-baee-bd28e6844bae tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1462 microversion: 2.1 time: 0.096593 May 11 18:59:34.989413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 167/330] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:34 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:35.481114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:35.481886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:35.488201 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:35.488656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:35.489433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:35.489876 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:35.927819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:35.939309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:35.942388 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:35.944088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-73717b18-31d5-4a6d-9195-0baea6a13349 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.467028 May 11 18:59:35.955676 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 164/331] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:35 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:35.966448 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:35.967635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:35.977949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:35.978709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:35.979545 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:35.980196 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:36.007351 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:36.008176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:36.018558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:36.019052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:36.019919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:36.020360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:36.094705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:36.102828 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-32916882-018c-4496-8103-03f078e12e8b tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1299 microversion: 2.1 time: 0.100600 May 11 18:59:36.103886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 165/332] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:36 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:36.397320 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:36.407427 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-19cb597c-a336-411f-ba23-a73d51ff3e26 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.445205 May 11 18:59:36.408631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 168/333] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:35 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:36.962787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:36.963503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:36.972656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:36.973109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:36.973904 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:36.974341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.123587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:37.125155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:37.132722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.133421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.134881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.135563 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.197016 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.197818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.198474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lazy-loading 'fault' on Instance uuid 501f1b0d-527c-42b0-809d-bae422c7e56e {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 18:59:37.235161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:37.244530 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:37.246225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:37.247738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-235d147b-e1d7-4dfe-9577-fcb5bb5483ef tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.288787 May 11 18:59:37.249677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 166/334] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:36 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:37.288125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04109028620d4b7284fbd32efc695c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335338c6d5e740d0b388702462e552ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:37.304570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1285a3d8-2190-4e14-9fd4-96036cb435ef tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 200 len: 1304 microversion: 2.1 time: 0.180122 May 11 18:59:37.305859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 169/335] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:37 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:37.427505 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:37.428233 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:37.435718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.436155 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.437059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.437559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.581527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:37.590447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ee438e56-866f-4858-8f61-b2a0673bbce4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1502 microversion: 2.1 time: 0.167940 May 11 18:59:37.591877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 167/336] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:37 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:37.608683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa5cccd4-c88c-4995-8995-446371d0add1"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:37.610156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:37.618939 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.619473 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.620307 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.621001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.648536 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] HTTP exception thrown: Cannot 'attach_volume' instance b57bf0b3-ec26-4008-9534-60b21519c99c while it is in vm_state rescued May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Request method failure captured: May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/os-volume_attachments HTTP/1.1 May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 74 May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcsGGgWD9RNIHOPFUGdk8L2sOaCDc95Cdt0R2wHKl6Mw__4fqbGLhBEyF7868GENhFJXpC-ojSKj0f9z4-_Y73kLdHW7e8kOxxf-A0GFvFoB1Vk5VAu4stie31mIIy8PVl6l_1mY9RqmllOzp57kIfaMLiQSH30_t9aedi7q3UCoqc May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:59:37.650958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d22bd9d4df840c1af348b3f257593a3", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: c9d83909ea2943f5834778a2a9aa1485 May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {"volumeAttachment": {"volumeId": "fa5cccd4-c88c-4995-8995-446371d0add1"}} May 11 18:59:37.652857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Cannot 'attach_volume' instance b57bf0b3-ec26-4008-9534-60b21519c99c while it is in vm_state rescued May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'server_id': 'b57bf0b3-ec26-4008-9534-60b21519c99c', 'body': {'volumeAttachment': {'volumeId': 'fa5cccd4-c88c-4995-8995-446371d0add1'}}} May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b57bf0b3-ec26-4008-9534-60b21519c99c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:59:37.653795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b57bf0b3-ec26-4008-9534-60b21519c99c while it is in vm_state rescued May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:37.660348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:37.661559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:59:37.661559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:59:37.661559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b57bf0b3-ec26-4008-9534-60b21519c99c while it is in vm_state rescued May 11 18:59:37.661559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:37.662779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Returning 409 to user: Cannot 'attach_volume' instance b57bf0b3-ec26-4008-9534-60b21519c99c while it is in vm_state rescued {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:59:37.664334 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-550c4004-8635-4dfe-8a71-1bf23d9bdd78 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059981 May 11 18:59:37.667684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 170/337] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 18:59:37 2022] POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 18:59:37.673965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:37.674501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:37.681221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.681661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.682646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.683283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.785286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9e548a82-6e2c-43d6-a652-f1558a1da570 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/action" status: 202 len: 0 microversion: 2.1 time: 0.114478 May 11 18:59:37.785921 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 168/338] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 18:59:37 2022] POST /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 18:59:37.795343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:37.796041 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:37.804509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.805026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:37.805823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:37.807263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:38.273219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:38.273920 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:38.283798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:38.284261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:38.287868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:38.288325 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:38.372888 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:38.386099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4267da0e-245c-4f4c-91e4-f7d90562c50e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1510 microversion: 2.1 time: 0.595489 May 11 18:59:38.387777 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 171/339] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:37 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1510 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:38.405721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:38.414038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] [instance: 501f1b0d-527c-42b0-809d-bae422c7e56e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:38.426031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:38.426831 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:38.428390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:38.429056 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:38.448344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] HTTP exception thrown: Instance 501f1b0d-527c-42b0-809d-bae422c7e56e could not be found. May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Request method failure captured: May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e HTTP/1.1 May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAdWo_p0aA3ZtcghY1Vj-1BBinw9m1_-0wtDd65WhvPtLmArOq1Gn0_SMJsTvKQrq5tqbFS5DndnUeL70cUZQonvCxzQk4rebVemkAb_JGbifNonr0ztSXAFLZc3oy4As-ndo4KVdEqFaNypbY0lhhBrQAX1DXymRMKJxvLlCnqU6hA May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 335338c6d5e740d0b388702462e552ef May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesActionsTest-854584466 May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 18:59:38.450280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/335338c6d5e740d0b388702462e552ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/335338c6d5e740d0b388702462e552ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_335338c6d5e740d0b388702462e552ef", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/335338c6d5e740d0b388702462e552ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesActionsTest-854584466 May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 335338c6d5e740d0b388702462e552ef May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesActionsTest-854584466 May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesActionsTest-854584466-project May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 04109028620d4b7284fbd32efc695c56 May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesActionsTest-854584466-project May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 501f1b0d-527c-42b0-809d-bae422c7e56e could not be found. May 11 18:59:38.451515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '501f1b0d-527c-42b0-809d-bae422c7e56e'} May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501f1b0d-527c-42b0-809d-bae422c7e56e could not be found. May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 18:59:38.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501f1b0d-527c-42b0-809d-bae422c7e56e could not be found. May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501f1b0d-527c-42b0-809d-bae422c7e56e could not be found. May 11 18:59:38.453294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 18:59:38.455996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] Returning 404 to user: Instance 501f1b0d-527c-42b0-809d-bae422c7e56e could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 18:59:38.461242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-dbe0a5b1-049c-416b-81a2-bc3c848b809a tempest-VolumesActionsTest-854584466 tempest-VolumesActionsTest-854584466-project] 10.222.0.93 "GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e" status: 404 len: 111 microversion: 2.1 time: 0.057964 May 11 18:59:38.462545 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 172/340] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:38 2022] GET /compute/v2.1/servers/501f1b0d-527c-42b0-809d-bae422c7e56e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 18:59:38.614974 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:38.627048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:38.636235 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:38.637462 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cd791e52-8a7a-4f1a-9fc5-7ed6b8d16ee9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.370193 May 11 18:59:38.647331 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 169/341] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:38 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 18:59:39.411670 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:39.413655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:39.428015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:39.428770 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:39.430455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:39.431874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:39.661580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:39.662284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:39.676842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:39.677304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:39.680898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:39.681527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:39.796125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:39.803506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ad2b51ab-ef67-47c2-92dc-46103d79a54c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1510 microversion: 2.1 time: 0.401949 May 11 18:59:39.804072 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 173/342] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:39 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:40.043165 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:40.054392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:40.068106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:40.069952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-db256015-acfe-486f-8d22-c62c1eda4120 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.417753 May 11 18:59:40.071056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 170/343] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:39 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:40.822107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:40.823609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:40.836799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:40.837256 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:40.838062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:40.838506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:41.088898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:41.089695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:41.101250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:41.101708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:41.107579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:41.108045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:41.116692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:41.150480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5f91e6d9-bde6-49d0-b05e-f34dbbfa25be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1510 microversion: 2.1 time: 0.323322 May 11 18:59:41.151161 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 174/344] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:40 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:41.517588 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:41.536388 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:41.537912 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:41.539110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cad5c5a7-1fbe-424d-bbf1-6498354fdc60 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.454634 May 11 18:59:41.551589 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 171/345] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:41 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:42.168438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:42.169227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:42.183076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:42.183731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:42.184688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:42.185888 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:42.411920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:42.428602 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-23c68fad-1d6e-475b-93d3-db6686bf28c7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1510 microversion: 2.1 time: 0.264204 May 11 18:59:42.429949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 175/346] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:42 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:42.561137 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:42.561745 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:42.571290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:42.577806 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:42.584456 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:42.585010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:42.755251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:42.775467 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:42.777939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:42.779183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2a3da01c-fc08-47cf-8018-4052e9d6fcf1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.223120 May 11 18:59:42.781089 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 172/347] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:42 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:43.448295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:43.449548 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:43.463997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:43.464471 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:43.465245 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:43.465679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:43.633989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:43.635250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:43.664362 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:43.665011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:43.668215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:43.668844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:43.723244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-80917e97-8c26-4a89-bdf7-8ee361a7ca84 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.097159 May 11 18:59:43.731021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 173/348] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 18:59:43 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:43.781655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:43.791963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-21e71c26-526c-47ab-aeae-9dd46ac835a7 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1510 microversion: 2.1 time: 0.348407 May 11 18:59:43.792549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 176/349] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:43 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:43.798293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:43.799394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:43.805838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:43.811159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:43.812899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:43.817519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:44.022873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:44.054473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:44.062429 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:44.068744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-92afe686-17ae-4394-831d-f7550374e127 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.273978 May 11 18:59:44.069938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 174/350] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:43 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:44.808954 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:44.809998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:44.818905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:44.819892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:44.820854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:44.821290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:44.983258 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:44.993192 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-af4a16c5-d24b-4b0c-aa26-3be203c83c81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1510 microversion: 2.1 time: 0.188024 May 11 18:59:44.994516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 177/351] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:44 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:45.090158 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:45.091496 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:45.099721 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:45.100307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:45.103414 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:45.103975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:45.267987 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:45.278206 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:45.282566 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:45.284290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cffb60b1-4335-42f7-957d-33eaf7367651 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.199564 May 11 18:59:45.285550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 175/352] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:45 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:45.387736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b370903b-556e-4553-aec8-1a5fe5e59e25"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:45.388776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:45.397194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:45.397874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:45.400028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:45.401656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:46.010659 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:46.011873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:46.018221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:46.019237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:46.020213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:46.022699 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:46.271779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:46.283731 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f3c9b5cc-dbf4-46a0-92f7-eafde7edbeaf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1516 microversion: 2.1 time: 0.277206 May 11 18:59:46.285234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 176/353] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:46 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 18:59:46.317336 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:46.318192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:46.326226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:46.327789 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:46.328852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:46.329670 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:46.735663 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:46.756862 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:46.758595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:46.760200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6bd2ecaa-df82-4bc3-be07-281acf90d9af tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.447879 May 11 18:59:46.761269 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 177/354] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:46 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:46.962412 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-48a59c8c-a2c8-48ad-9f24-c1d74f910655 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.572003 May 11 18:59:46.965732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 178/355] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 18:59:45 2022] POST /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments => generated 194 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:47.787966 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:47.789794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:47.803285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:47.803952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:47.805099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:47.807232 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:47.994696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:48.004385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:48.005899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:48.007171 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a2c3013b-a531-46e2-b4f8-74cb0249edeb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.226311 May 11 18:59:48.007757 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 178/356] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:47 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:48.145828 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9aa2ec5c-bfdd-4009-adde-a0fc7a45ba3c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'create', calling method: .version_select at 0x7fa78c1d4700>, body: {"keypair": {"name": "tempest-keypair-1902814533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISADEKsTvQDnEUe3OkERxLZLSv1j8Zpq/6Pze7P5DH2KUvM5O66tXkO4FhJKVu+RI+JKKM54VKjrEdXbwHZZAUVEuO7wrMLyLLQh5it/pZdmcGM2U8VhmL7pr0ljCZr8g=="}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:48.176674 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-9aa2ec5c-bfdd-4009-adde-a0fc7a45ba3c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:48.180829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-9aa2ec5c-bfdd-4009-adde-a0fc7a45ba3c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for user c9d83909ea2943f5834778a2a9aa1485 and project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:48.223643 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9aa2ec5c-bfdd-4009-adde-a0fc7a45ba3c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082528 May 11 18:59:48.226960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 179/357] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 18:59:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:49.026701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:49.030938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:49.038653 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:49.039414 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:49.040399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:49.040985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:49.380566 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:49.392249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:49.400329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:49.401843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f066797a-e958-4520-8c9f-54bf832fa540 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.379448 May 11 18:59:49.402719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 179/358] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:49 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:50.453247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:50.458150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:50.482636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:50.490924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:50.492939 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:50.496944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:50.837448 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:50.861311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:50.870123 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:50.874119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f5582639-3792-4772-85bb-c2572ae1eb4e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.453487 May 11 18:59:50.879499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 180/359] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:50 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:51.781927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-570007060", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd3e1807-14a6-4444-9e3f-94c5a4601ebb"}], "security_groups": [{"name": "tempest-securitygroup--1767481691"}], "key_name": "tempest-keypair-1902814533", "user_data": "}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:51.898615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:51.899321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:51.911445 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:51.911940 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:51.912807 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:51.913213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:52.145707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:52.154959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:52.160184 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:52.163262 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a50f36b4-25f4-45bf-b9d2-05879775b31f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.269823 May 11 18:59:52.213891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 181/360] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:51 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:53.246336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:53.249539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:53.279405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:53.281063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:53.285649 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:53.290076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:53.584900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:53.600841 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:53.602365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:53.607928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-63ba816a-3683-409c-a854-7003705592f1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.379356 May 11 18:59:53.615892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 182/361] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:53 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:54.628362 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:54.629115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:54.660443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:54.660906 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:54.661709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:54.662149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:54.992575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:55.007984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:55.009928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:55.011181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0c3ca8d2-f19d-4375-a005-299a917bc118 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.387837 May 11 18:59:55.022206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 183/362] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:54 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:56.030822 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:56.031806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:56.050264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:56.054582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:56.055801 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:56.057998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:56.444343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:56.456574 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:56.458728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:56.460713 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6ab4b0c4-5e00-4f4b-8530-3fcd4ce60746 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1743 microversion: 2.20 time: 0.434543 May 11 18:59:56.461793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 184/363] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:56 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1743 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:56.469048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d0c989d8-3a8a-4474-ba95-6b9231ca880a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: .version_select at 0x7fa7877dadc0>, body: {"keypair": {"name": "tempest-keypair-179025171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN16CKAQbNoZrPpMtCf+06LkWAknRKPe7NsYbjtf3iLbrbCs+BDKWB5UgM6FC+3PJG0KcUezWVJzsi+BhKariA4vJo0VOIPxZDzHtR5bIFps5C4pnfdZuOzLN0mSRw+yiw=="}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:56.493517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-d0c989d8-3a8a-4474-ba95-6b9231ca880a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:56.499637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-d0c989d8-3a8a-4474-ba95-6b9231ca880a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:56.539496 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d0c989d8-3a8a-4474-ba95-6b9231ca880a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075464 May 11 18:59:56.540449 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 185/364] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 18:59:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:56.702424 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-494ad291-f82b-4e71-b1fc-bf51b3dcf62d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Action: 'create', calling method: .version_select at 0x7fa787771940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-454194005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNa63X9GHedqEHkVgQTI2Pnei9e4+T+w74GLrdBy3EQt2hn0v6FTz2TBGED/DIE75ULmiyikWOa+ciJnxYKUjD7Kbw6lK9oqrNAcWfbyfkFusD81Stq1o9PRn+CzTUuH0w=="}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:56.764769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-494ad291-f82b-4e71-b1fc-bf51b3dcf62d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Getting quotas for project 4be93dc182224cfe8be43a23dadbb62f. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:56.778186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-494ad291-f82b-4e71-b1fc-bf51b3dcf62d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Getting quotas for user 2558a8c34b324bc99b157b306c9cdf7b and project 4be93dc182224cfe8be43a23dadbb62f. Resources: {'key_pairs'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:56.831075 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-494ad291-f82b-4e71-b1fc-bf51b3dcf62d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.133815 May 11 18:59:56.844789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 186/365] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 18:59:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 18:59:57.019575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-519331076", "imageRef": "c1b86353-bf25-4b6f-a287-9e0165af0aa1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-454194005", "networks": [{"uuid": "e31faa47-02d3-4d08-aea1-b331ac0b21b1"}]}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:57.046975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] validate_networks() for [('fd3e1807-14a6-4444-9e3f-94c5a4601ebb', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:59:57.110867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] validate_networks() for [('e31faa47-02d3-4d08-aea1-b331ac0b21b1', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:59:57.916286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:59:57.917064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:59:57.917608 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:59:57.918213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:59:57.918943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:59:57.929736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:57.930639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:57.931761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:57.932401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:57.952247 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:57.956537 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Getting quotas for user c9d83909ea2943f5834778a2a9aa1485 and project 1d22bd9d4df840c1af348b3f257593a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:57.969119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:59:57.971949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:59:57.984215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:59:57.984665 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:59:57.985196 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:59:57.985733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:59:57.986296 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:59:57.995879 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:57.996337 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:57.997130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:57.997570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:58.019757 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Getting quotas for project 4be93dc182224cfe8be43a23dadbb62f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:58.024790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Getting quotas for user 2558a8c34b324bc99b157b306c9cdf7b and project 4be93dc182224cfe8be43a23dadbb62f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:58.040793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d8d0410f-0e0e-4189-bcf3-429458b5c095 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.269692 May 11 18:59:58.041357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 180/366] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:59:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 6273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 18:59:58.050896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:58.053003 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:58.057519 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:59:58.060847 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:58.061502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:58.062099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1b86353-bf25-4b6f-a287-9e0165af0aa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 18:59:58.062708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:58.063322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:58.141177 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d7c42c64-000f-432a-afa5-5622f264e73b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126307 May 11 18:59:58.148405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 187/367] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 18:59:58.154960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-7fe8c047-49a6-486e-8d29-aeeaee59ab42 req-041021f0-53c7-4e8f-9b8a-3e555949ba34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "name": "network-vif-plugged", "status": "completed", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:58.166544 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7fe8c047-49a6-486e-8d29-aeeaee59ab42 req-041021f0-53c7-4e8f-9b8a-3e555949ba34 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:58.167405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7fe8c047-49a6-486e-8d29-aeeaee59ab42 req-041021f0-53c7-4e8f-9b8a-3e555949ba34 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:58.193836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-7fe8c047-49a6-486e-8d29-aeeaee59ab42 req-041021f0-53c7-4e8f-9b8a-3e555949ba34 service nova] Creating event network-vif-plugged:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 18:59:58.203987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-7fe8c047-49a6-486e-8d29-aeeaee59ab42 req-041021f0-53c7-4e8f-9b8a-3e555949ba34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053272 May 11 18:59:58.205036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 188/368] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 18:59:58.214993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-223ddec4-4c8a-4c28-9482-b3e4b111d988 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:58.215970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-223ddec4-4c8a-4c28-9482-b3e4b111d988 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:58.275913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-223ddec4-4c8a-4c28-9482-b3e4b111d988 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:58.285165 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-223ddec4-4c8a-4c28-9482-b3e4b111d988 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1245 microversion: 2.1 time: 0.076576 May 11 18:59:58.286096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 189/369] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:58 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:58.304063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-42df3193-f6f4-40a4-8f7c-2a4a23e7c27e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:58.304905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-42df3193-f6f4-40a4-8f7c-2a4a23e7c27e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:58.366192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:58.379862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-42df3193-f6f4-40a4-8f7c-2a4a23e7c27e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:58.386789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-42df3193-f6f4-40a4-8f7c-2a4a23e7c27e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1257 microversion: 2.1 time: 0.088733 May 11 18:59:58.387370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 190/370] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:58 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1257 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:58.410100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:58.412251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:58.414220 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-05759748-6959-45c0-b40b-e0c7c747d5eb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1743 microversion: 2.20 time: 0.371478 May 11 18:59:58.415709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 181/371] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:58 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1743 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:59.231047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984455755", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834a0-4dee-47c7-b460-ae66831e3d5b"}], "security_groups": [{"name": "tempest-securitygroup--1956633803"}], "key_name": "tempest-keypair-179025171", "user_data": "}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 18:59:59.311126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:59.312695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:59.326171 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.326619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.327449 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.328017 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.387003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] validate_networks() for [('6b6834a0-4dee-47c7-b460-ae66831e3d5b', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 18:59:59.430301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:59.438883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-23f0bb96-12c7-4f16-8e60-7fe5629ba1b5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1297 microversion: 2.1 time: 0.133847 May 11 18:59:59.439497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 182/372] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:59 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:59.444754 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:59.445587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:59.455374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.455862 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.456685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.457276 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.544458 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:59.554144 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-812b8bed-bd6b-445b-b6f4-baeb6bd356b5 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1309 microversion: 2.1 time: 0.112209 May 11 18:59:59.556916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 183/373] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 18:59:59 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 18:59:59.563477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 18:59:59.565201 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 18:59:59.580418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.580892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.581853 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.582582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.781219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:59.792773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:59.798279 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 18:59:59.800416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a797a207-b64c-46b4-9dc6-997539e13462 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.240694 May 11 18:59:59.806591 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 184/374] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 18:59:59 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 18:59:59.923079 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 18:59:59.923540 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 18:59:59.924066 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 18:59:59.926071 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 18:59:59.926694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 18:59:59.937939 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.938363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.939146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 18:59:59.941832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 18:59:59.960738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 18:59:59.965623 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 18:59:59.977889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 18:59:59.980219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:00:00.061702 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-563a4cd5-95af-4e6c-89a3-60adf6b1cf93 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.834899 May 11 19:00:00.062362 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 191/375] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 18:59:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:00:00.072583 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bce145b0-6cfc-48a8-8648-84f298422487 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:00.073485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bce145b0-6cfc-48a8-8648-84f298422487 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:00.189806 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bce145b0-6cfc-48a8-8648-84f298422487 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:00.200542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bce145b0-6cfc-48a8-8648-84f298422487 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1241 microversion: 2.1 time: 0.129597 May 11 19:00:00.216758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 185/376] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:00 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:00.458847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:00.461204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:00.484989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:00.485796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:00.490366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:00.492710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:00.576097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:00.577401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:00.594927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:00.595997 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:00.598481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:00.598935 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:00.741343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:00.775158 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:00.783025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-70e89284-b479-4940-aaf7-e6e3350bc53f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1315 microversion: 2.1 time: 0.329221 May 11 19:00:00.786906 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ceb8189f-d863-4e5c-a359-a67303229444 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1317 microversion: 2.1 time: 0.216258 May 11 19:00:00.788927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 186/377] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:00 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:00.807654 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 192/378] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:00 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:00.829718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:00.831332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:00.847051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:00.848231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:00.852433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:00.853144 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:01.215999 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:01.216687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:01.227439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:01.229918 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:01.230268 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:01.237967 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:01.238941 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:01.243219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:01.245535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:01.251491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-01ace3ac-c4ce-4d2d-8b4d-2b5e2ed4061f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.429773 May 11 19:00:01.260218 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 187/379] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:00 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:01.373672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:01.382663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3b16b995-5ac9-40d9-aeb4-edfb83e1c3a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1245 microversion: 2.1 time: 0.171675 May 11 19:00:01.387650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 193/380] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:01 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1245 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:01.813490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:01.814072 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:01.814430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:01.814822 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:01.836553 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:01.837011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:01.837826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:01.841944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:01.858201 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:01.858794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:01.859937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:01.860388 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:02.311604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:02.320757 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b41a6dc7-c858-41fb-a346-7c49519fcc33 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.511167 May 11 19:00:02.324145 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 194/381] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:01 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:02.340009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:02.340630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:02.362405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:02.364726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:02.368094 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:02.375196 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:02.800928 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:02.809856 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-93128df7-1b3c-49e5-afab-5df0e8215592 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 1.001291 May 11 19:00:02.831535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 188/382] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:01 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:02.844001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:02.850561 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:02.857152 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:02.870271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:02.871591 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:02.873609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:02.974755 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:02.996328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:03.003628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:03.009360 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-164b240b-cfc5-4e50-813c-ac325e8d8910 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.681983 May 11 19:00:03.014680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:03.027611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 195/383] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:02 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:03.035671 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3231f576-e336-4437-8cff-a5b871d083fd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1299 microversion: 2.1 time: 0.201242 May 11 19:00:03.036587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 189/384] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:02 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:03.338544 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:03.339561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:03.352720 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:03.353466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:03.354435 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:03.355030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:03.839931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:03.841229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:03.864986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:03.875154 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:03.877229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:03.883934 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:04.411963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:04.423639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6eae6088-01fe-4e32-aca9-14a00e7b3d7d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.586210 May 11 19:00:04.425980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 190/385] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:03 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:04.441953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:04.452892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:04.476270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:04.476732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:04.477518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:04.478962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:04.510136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:04.519146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-10c59fc2-4b01-4621-b9b0-b23add4a41ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 1.184551 May 11 19:00:04.523785 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 196/386] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:03 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:04.536543 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:04.537778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:04.563238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:04.564046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:04.571388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:04.572185 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:05.059541 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:05.085433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:05.087448 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:05.092134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d74a7fc2-9de3-415a-acc3-07fa283f2561 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.664935 May 11 19:00:05.122083 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 191/387] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:04 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:05.134266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-cc8a81e7-9793-4510-acda-4682a4b1d1e2 req-b1ee3ec0-3c22-4da0-a858-96c42b3408b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:05.146593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-cc8a81e7-9793-4510-acda-4682a4b1d1e2 req-b1ee3ec0-3c22-4da0-a858-96c42b3408b9 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:05.147157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-cc8a81e7-9793-4510-acda-4682a4b1d1e2 req-b1ee3ec0-3c22-4da0-a858-96c42b3408b9 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:05.163823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-cc8a81e7-9793-4510-acda-4682a4b1d1e2 req-b1ee3ec0-3c22-4da0-a858-96c42b3408b9 service nova] Creating event network-changed:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:00:05.169779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-cc8a81e7-9793-4510-acda-4682a4b1d1e2 req-b1ee3ec0-3c22-4da0-a858-96c42b3408b9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 May 11 19:00:05.170954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 192/388] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:05.177469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1696980504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-203305523", "security_groups": [{"name": "tempest-secgroup-smoke-73155537"}], "networks": [{"uuid": "25c5b16b-a83d-4c15-a057-126aac162243"}], "block_device_mapping_v2": [{"uuid": "8d5e6e77-4ef8-4436-baea-15ff891de43b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:05.617687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:05.618694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] validate_networks() for [('25c5b16b-a83d-4c15-a057-126aac162243', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:00:05.633819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f4a4b43e-fcf4-466d-abbd-3bd06fbf3952 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 1.099172 May 11 19:00:05.644039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 197/389] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:04 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:05.667231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:05.667896 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:05.706943 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:05.708089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:05.709381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:05.715976 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:06.368993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:06.386178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5c90a3d1-b8e3-4b3b-8643-934a2d8fe6c3 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.735628 May 11 19:00:06.388924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 198/390] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:05 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:06.409805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:06.413248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:06.432275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:06.435077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:06.436111 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:06.444795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:06.804148 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:00:06.804728 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:00:06.805200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:00:06.805845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:00:06.806483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:00:06.817999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:06.820528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:06.828832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:06.829615 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:06.862139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Getting quotas for project 7d1d877d09894265a3ecb65f70684a29. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:00:06.879869 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Getting quotas for user 521ce300deaf4ebba282688e5b8fa394 and project 7d1d877d09894265a3ecb65f70684a29. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:00:07.054106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:00:07.056399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d5e6e77-4ef8-4436-baea-15ff891de43b',volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:00:07.395550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-216506ed-dc6d-4c92-b42a-3ebf0cd74967 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.222034 May 11 19:00:07.398829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 193/391] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:00:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:00:07.426012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:07.427159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:07.460924 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:07.467128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:07.468289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:07.472007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:07.972933 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:07.995410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:08.001901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:08.009562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:08.030347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f47da6ba-559c-441a-8fa6-18f6ddbf3dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.626681 May 11 19:00:08.035732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 194/392] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:07 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:08.042124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b7f2a295-ecd8-4f29-91d5-342832e3f951 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 1.648905 May 11 19:00:08.050127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 199/393] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:06 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:08.065190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:08.066130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:08.066472 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-b3d87d50-8e14-4e14-bb8b-a345b7f8b311 req-e90fe2ee-17ef-49f2-8cb2-79dea7f5ee1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73aaf5-ec3f-4e29-8e67-597130c372fb", "tag": "881f218e-3373-430b-89cc-fb0562f0fcfd"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:08.074893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.075753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.076956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.077596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.088788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-b3d87d50-8e14-4e14-bb8b-a345b7f8b311 req-e90fe2ee-17ef-49f2-8cb2-79dea7f5ee1e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.089768 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-b3d87d50-8e14-4e14-bb8b-a345b7f8b311 req-e90fe2ee-17ef-49f2-8cb2-79dea7f5ee1e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.125831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-b3d87d50-8e14-4e14-bb8b-a345b7f8b311 req-e90fe2ee-17ef-49f2-8cb2-79dea7f5ee1e service nova] Creating event network-changed:881f218e-3373-430b-89cc-fb0562f0fcfd for instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb on hv-cinder-75510 May 11 19:00:08.142325 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-b3d87d50-8e14-4e14-bb8b-a345b7f8b311 req-e90fe2ee-17ef-49f2-8cb2-79dea7f5ee1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100536 May 11 19:00:08.144967 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 195/394] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:08.165431 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:08.166735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:08.184347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.185996 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.188732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.192108 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.438389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:08.456181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f197c435-7220-418d-9a94-fef1702c7e1d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.306885 May 11 19:00:08.462078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 196/395] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:08 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:08.468012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:08.468930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:08.489976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.497479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.501555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:08.508720 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:08.638827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:08.652146 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-edb3f14e-dd40-463b-bbdc-8fd2a40fb22d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1138 microversion: 2.1 time: 0.184276 May 11 19:00:08.653263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 197/396] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:08 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1138 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:08.778325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:08.786999 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7c96e6ba-bc48-4250-ab1e-90c19f60c1e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.734464 May 11 19:00:08.787643 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 200/397] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:08 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:09.066874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:09.070225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:09.071683 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:09.073744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:09.125655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:09.126402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:09.126716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:09.127340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:09.130230 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:09.135997 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:09.136958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:09.137625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:09.553593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:09.573017 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:09.574619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:09.575857 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-30642d60-e7d3-456b-878c-dd9d32ef32e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.528332 May 11 19:00:09.576424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 198/398] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:09 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:09.587085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:09.590534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:09.617003 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:09.620231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:09.626712 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:09.627631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.239870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:10.258752 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4bb7dc68-5a5e-424a-b055-bcdd7e6e8a40 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 1.196716 May 11 19:00:10.263840 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 201/399] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:09 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:10.286615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:10.292149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:10.314337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:10.318191 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.318635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.326519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-739d6568-f372-4e38-aeba-816d8f0cb9d9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.748909 May 11 19:00:10.326703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.327006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.338469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 199/400] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:09 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:10.348050 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:10.349176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:10.357386 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.358177 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.359290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.372333 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.585405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:10.598158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3832469c-0841-4a33-b9a4-5a7e568a1f68 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1204 microversion: 2.1 time: 0.333163 May 11 19:00:10.598747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 202/401] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:10 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1204 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:10.621638 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-ce3b8e5f-d55a-487c-9ab8-97ee0365ab7f req-21706523-c9f8-476d-99a3-6c0b44269286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566e7940-0d8b-421c-87de-d7fc5c7db98a", "tag": "e43aea4f-9550-41a9-8237-a44c594c43ea"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:10.653816 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-ce3b8e5f-d55a-487c-9ab8-97ee0365ab7f req-21706523-c9f8-476d-99a3-6c0b44269286 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.654547 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-ce3b8e5f-d55a-487c-9ab8-97ee0365ab7f req-21706523-c9f8-476d-99a3-6c0b44269286 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.705351 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-ce3b8e5f-d55a-487c-9ab8-97ee0365ab7f req-21706523-c9f8-476d-99a3-6c0b44269286 service nova] Creating event network-changed:e43aea4f-9550-41a9-8237-a44c594c43ea for instance 566e7940-0d8b-421c-87de-d7fc5c7db98a on hv-cinder-75510 May 11 19:00:10.722709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-ce3b8e5f-d55a-487c-9ab8-97ee0365ab7f req-21706523-c9f8-476d-99a3-6c0b44269286 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104553 May 11 19:00:10.723995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 203/402] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:10.730405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:10.731476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:10.748254 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.749114 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.753536 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:10.754336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:10.767225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:10.775334 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b7d5665e-e45a-4225-a991-65399456fb5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.434381 May 11 19:00:10.779337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 200/403] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:10 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:11.280695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:11.281347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:11.302523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:11.303657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:11.305444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:11.306326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:11.386599 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:11.407241 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:11.412933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:11.416686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5c1945d4-f748-4acd-ab4e-2bb38f7f2461 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.691040 May 11 19:00:11.421551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 204/404] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:10 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:11.434356 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:11.436542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:11.457236 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:11.458105 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:11.459217 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:11.460195 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:11.812557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:11.827524 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b4d3faf1-58f3-4fd6-8041-1e5269869de7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.403771 May 11 19:00:11.838261 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 205/405] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:11 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:11.859825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:11.860845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:11.893164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:11.894015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:11.895438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:11.899094 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.373470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:12.387994 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7e8d42a6-1113-48f9-b8d3-aa77e12dfac5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 1.105690 May 11 19:00:12.403690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 201/406] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:11 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:12.412442 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:12.415639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:12.430974 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.434521 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.435603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.436569 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.790300 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:12.801874 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:12.802567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d925e0a3-19bf-4737-a257-9e0c04b254dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.962803 May 11 19:00:12.803154 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 206/407] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:11 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:12.816477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-83c592b3-af89-4ec2-98b9-662f5dd1f074 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.411313 May 11 19:00:12.817679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 202/408] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:12 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:12.823497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:12.824339 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:12.831703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:12.832628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:12.833672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.834358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.836898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.837533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.851823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.852517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.853471 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.854043 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.905521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-21093ce7-e9f2-4fa2-9aff-9cdc14e992f6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/ips" status: 200 len: 144 microversion: 2.1 time: 0.100811 May 11 19:00:12.913202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 207/409] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 19:00:12 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/ips => generated 144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:12.919947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:12.920668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:12.941288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.941829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:12.942704 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:12.943218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:13.119784 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:13.134995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:13.137073 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:13.140576 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0aa92e0c-5cd9-4808-83af-09a9d45b2112 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.321773 May 11 19:00:13.143598 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 203/410] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:12 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:13.405911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:13.407980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:13.421329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:13.422132 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:13.423131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:13.423631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:13.449290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:13.461528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6b64941c-9ee8-457e-85ef-9512c9ee58ef tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.551376 May 11 19:00:13.468383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 208/411] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:12 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:13.748032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:13.776487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b45b1afd-1dcf-47ec-b818-62cffafc56a2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.374254 May 11 19:00:13.777971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 204/412] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:13 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:13.831585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:13.832862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:13.858123 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:13.859711 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:13.862057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:13.863485 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:13.864005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:13.865176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:13.872180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:13.874601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:13.875881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:13.876566 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:14.281459 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:14.289559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9e167183-13d7-4fc7-9e45-75bde170ff55 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.466124 May 11 19:00:14.290133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 209/413] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:13 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:14.318052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:14.333102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:14.358397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:14.359825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:14.364373 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:14.370117 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:14.536283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:14.553075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5f7eac40-f4c2-414b-bced-578ea81725e4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.722739 May 11 19:00:14.556637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 205/414] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:13 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:14.569818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:14.575636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:14.594087 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:14.594701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:14.597693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:14.598692 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:14.787641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:14.806628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:14.813290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:14.823033 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d31b1271-3aae-4093-a30f-c85d667c92cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.516133 May 11 19:00:14.825201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 210/415] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:14 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:14.849825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:14.851105 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:14.861032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:14.862544 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:14.866425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:14.867141 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.158124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:15.174480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0afa2731-fe69-4776-9345-db077bcd4b43 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.345815 May 11 19:00:15.175095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 211/416] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:14 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:15.186655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-b8a53878-c37f-4d0a-92f3-ef51514bc750 req-779f71ec-4840-4422-af31-e1d6f1847a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:15.204882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-b8a53878-c37f-4d0a-92f3-ef51514bc750 req-779f71ec-4840-4422-af31-e1d6f1847a8b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.209768 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-b8a53878-c37f-4d0a-92f3-ef51514bc750 req-779f71ec-4840-4422-af31-e1d6f1847a8b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.232004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-b8a53878-c37f-4d0a-92f3-ef51514bc750 req-779f71ec-4840-4422-af31-e1d6f1847a8b service nova] Creating event network-changed:c94167a9-9991-43a1-8fe8-7f90f0e5fd82 for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b on hv-cinder-75510 May 11 19:00:15.243329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-b8a53878-c37f-4d0a-92f3-ef51514bc750 req-779f71ec-4840-4422-af31-e1d6f1847a8b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063684 May 11 19:00:15.253433 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 212/417] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:15.309134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:15.310781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:15.321407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:15.323144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.323795 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.328751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.329381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.331039 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f759a8f9-4e96-4700-adab-a306b5d829a7 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.772755 May 11 19:00:15.338922 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 206/418] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:14 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:15.575159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:15.576797 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:15.585600 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.586571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.587609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.588257 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.655854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:15.676215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-44edb773-a60d-4cdb-884d-776e323e8897 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.371053 May 11 19:00:15.678003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 213/419] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:15 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:15.853677 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:15.854571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:15.880389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:15.886094 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.886820 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.887828 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:15.892113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:15.898502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8dc912f1-e861-4aee-9e63-46ed1e176f58 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.327069 May 11 19:00:15.901129 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 207/420] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:15 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:16.033460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86e9de11-fd03-475f-93da-fe8773b17d8d"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:16.036330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:16.052649 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:16.056752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:16.069985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:16.070606 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:16.391476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:16.415056 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:16.430255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:16.431534 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b932e0e7-ab85-40ca-a156-58e449e08d63 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.588527 May 11 19:00:16.437687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 214/421] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:15 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:16.454391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:16.459706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:16.484844 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:16.485590 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:16.487896 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:16.488760 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:16.634223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ad08c3c1-a2bb-4a2a-9973-6192623859d7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605300 May 11 19:00:16.640134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 208/422] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:00:16 2022] POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-volume_attachments => generated 194 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:00:16.661592 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:16.681517 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:16.706671 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:16.708890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:16.710451 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:16.711881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:17.057831 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:17.089164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7785a333-245f-4f49-abf2-ebe2ab68ce04 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.650140 May 11 19:00:17.089747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 215/423] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:16 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:17.133622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:17.133938 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:17.155767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:17.156221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:17.157101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:17.172454 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:17.452212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:17.461127 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5d64b3d6-f375-492b-a448-9258b0107e2e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.818587 May 11 19:00:17.461782 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 209/424] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:16 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:17.476708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:17.477369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:17.484184 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:17.485733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:17.486609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:17.488092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:17.756897 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:17.764608 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:17.774550 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-02e98eb0-10fe-41a5-a186-52250a5d4bb2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.655182 May 11 19:00:17.774841 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-02d290fc-11f7-4121-9330-7788cdce82a8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.302331 May 11 19:00:17.777423 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 216/426] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:17 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:17.777602 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 210/426] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:17 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:17.794301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:17.794301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:17.818482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:17.818961 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:17.822425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:17.825128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.117919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:18.124475 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:18.139766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.143132 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.146700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.147474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.421401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:18.429349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:18.430853 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:18.432057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9a7bce37-10f3-4af0-8348-47ea2a3f0dda tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.653393 May 11 19:00:18.432625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 211/427] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:17 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:18.478649 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:18.479208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:18.486635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.487090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.487902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.488337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.501613 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:18.520889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e7916940-9e33-4c58-af07-0f930eecf531 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.407329 May 11 19:00:18.522297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 217/428] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:18 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:18.777449 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:18.787474 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3cc14c36-90c1-4ee7-be68-d48da243c075 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.313134 May 11 19:00:18.797660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:18.797660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:18.803858 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.804135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.804260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 212/429] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:18 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:18.812918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:18.813817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:18.824454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.825675 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.826798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.827553 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:18.834325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:18.834929 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.037412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.052678 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-06945091-38c0-48d3-bdfd-14cd5b23b26d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.245895 May 11 19:00:19.060208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 213/430] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:18 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:19.101427 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.111077 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6c7b277f-5272-49ae-8f62-936f894fa62d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.321165 May 11 19:00:19.113165 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 218/431] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:18 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:19.454409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:19.455379 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:19.463580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:19.467978 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.472358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:19.473011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.539265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:19.540570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:19.550370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:19.552784 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.553903 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:19.555960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.744212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.763416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.765039 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.771507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5188ebf7-95be-450b-a7b5-a3deea3b043a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.323265 May 11 19:00:19.774659 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 214/432] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:19 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:19.778621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.786887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-66f078da-bf0a-46af-bd6e-2be4eca93f58 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.252060 May 11 19:00:19.788365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 219/433] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:19 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:19.807082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:19.807847 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:19.817571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:19.818215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.818808 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:19.819550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:19.983587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:19.993634 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bc20e93a-51c9-4dbf-9a02-289eb8ce545a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.190789 May 11 19:00:19.994225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 215/434] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:19 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:20.073611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:20.074796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:20.086190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.086975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.088026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.096397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.130893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:20.131574 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:20.143319 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.143785 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.144689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.155284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.295019 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:20.312052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c36e838b-d499-4dec-a792-1fa10c98dad7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.242387 May 11 19:00:20.312839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 220/435] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:20 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:20.374016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:20.381580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-aa075837-dea0-4372-8493-e4371e7f15c8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.256043 May 11 19:00:20.394026 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 216/436] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:20 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:20.791678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:20.795464 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:20.804566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.805355 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.806007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:20.806459 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.806836 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:20.807812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.818707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.819532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:20.820237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:20.820672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.010901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.022669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.024615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.026081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-70f19fc1-5c6f-45e4-95f6-7728f0b654b5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.238165 May 11 19:00:21.026835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 221/437] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:20 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:21.032893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:21.033879 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:21.040242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:21.041064 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.042050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:21.042644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.064142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.092779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9b41ff4b-652c-4be5-a750-8454068646d2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.291133 May 11 19:00:21.105890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 217/438] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:20 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:21.273288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.282182 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-eb77b92e-26f9-4eb2-b3bd-6b27e733cda4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.253808 May 11 19:00:21.282993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 222/439] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:21 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:21.329460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:21.330664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:21.337608 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:21.338068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.338847 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:21.339284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.407468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:21.409584 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:21.427813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:21.428262 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.431134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:21.431608 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:21.513099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.521437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0d9c9039-11b0-4c7b-9831-91b3b0b1dab4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.196037 May 11 19:00:21.522417 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 218/440] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:21 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:21.670461 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:21.683440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0ec80312-539a-473e-ad02-f8ab666e090c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.289082 May 11 19:00:21.697934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 223/441] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:21 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:22.043637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:22.044360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:22.056994 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.065002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.066049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.066712 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.112541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:22.113366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:22.125697 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.128170 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.128970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.129407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.334799 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.342886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.344412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.345615 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2784e6ab-2aeb-424c-b28f-b3cdc6ccedb0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.305919 May 11 19:00:22.346663 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 219/442] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:22 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:22.351686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:22.352728 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:22.358849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.359562 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.360553 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.360991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.400024 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.408985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-796639ba-2555-4ebf-a8de-36b9d87dfb73 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.300694 May 11 19:00:22.409570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 224/443] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:22 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:22.541039 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.543281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:22.547233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:22.556380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-83a7ad53-a30c-4ec7-a316-620f73e035ab tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.208350 May 11 19:00:22.561565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.561943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 220/444] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:22 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:22.562623 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.563735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.564924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.703693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:22.704440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:22.708455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.711093 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.711579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.712704 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:22.713297 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:22.719034 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e706603a-2ce2-4bdc-9144-04421ae9a42d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.184328 May 11 19:00:22.731463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 225/445] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:22 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:22.956733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:22.965648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-813f7645-3b67-4b02-a872-c79a6b980741 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.265817 May 11 19:00:22.966236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 221/446] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:22 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:23.371901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:23.372799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:23.382224 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.382688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.383532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.383960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.427593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:23.428921 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:23.437059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.437497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.442058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.442520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.618632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:23.634366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:23.636029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:23.637651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-24d69c59-f9f2-437c-b88c-b477c3d91e0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.274574 May 11 19:00:23.638265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 226/447] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:23 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:23.648758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:23.648758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4a479bf5-e9f5-43e3-acb6-fb24b99702af tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.223620 May 11 19:00:23.656967 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 222/448] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:23 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:23.668356 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:23.668985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:23.682871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.683257 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.684061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.684679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.742724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:23.743656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:23.760537 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.762504 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.763572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:23.769392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:23.920385 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:23.929667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c5577760-28f1-4756-b2a4-1770951c7a4c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.279016 May 11 19:00:23.938988 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 227/449] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:23 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:23.987318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:23.987318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:24.001517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.002014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.003148 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.003267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.052327 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:24.063133 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1375f5d6-5b13-4c4b-a2b8-a3af92ddede5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.328715 May 11 19:00:24.077607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 223/450] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:23 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:24.279283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:24.291406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bda409bb-ab2a-4f80-8cef-7ec456fc9839 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.311607 May 11 19:00:24.292614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 228/451] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:23 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:24.659904 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:24.661348 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:24.672919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:24.673551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:24.682187 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.682811 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.683546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.684006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.690786 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.695552 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.699100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.701692 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.861676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:24.871799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9cf53bfd-6c66-4c71-b0f2-fa808dc91d6f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.210415 May 11 19:00:24.875346 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 229/452] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:24 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:24.947496 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:24.948112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:24.967829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.968283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:24.969225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:24.969660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:25.243529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:25.253913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0fd443fe-2fee-4dbf-a52d-5d7c774f11df tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.311327 May 11 19:00:25.263417 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 230/453] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:24 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:25.268511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:25.269296 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:25.276377 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:25.277071 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:25.278040 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:25.278647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:25.403375 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:25.412640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:25.414437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:25.415913 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b459cc88-fcbf-40f8-a655-288764917c0e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.761858 May 11 19:00:25.417004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 224/454] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:24 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:25.425190 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:25.426682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:25.438409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:25.439199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:25.440853 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:25.441451 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:25.589688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:25.605825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aa72f07f-6958-4dc2-97bb-3cd4dee026fe tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.338387 May 11 19:00:25.618494 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 231/455] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:25 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:25.700478 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:25.707964 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b9d496ec-e9fc-4b6a-81ff-940ea6576a99 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.289492 May 11 19:00:25.708587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 225/456] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:25 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:25.893541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:25.894550 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:25.906046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:25.906819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:25.908793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:25.909534 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.047332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.056631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-25490841-96f7-4f2f-a193-501150233e1b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.170565 May 11 19:00:26.057227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 232/457] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:25 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:26.272916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:26.273859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:26.287868 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-d226ffd1-3752-4f5d-8dd2-ef33c9f98c3b req-7e096134-587f-4005-88e9-e6286fa56dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73aaf5-ec3f-4e29-8e67-597130c372fb", "name": "network-vif-plugged", "status": "completed", "tag": "881f218e-3373-430b-89cc-fb0562f0fcfd"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:26.299919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.304122 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-d226ffd1-3752-4f5d-8dd2-ef33c9f98c3b req-7e096134-587f-4005-88e9-e6286fa56dd7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.304917 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.305926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.306520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.307258 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-d226ffd1-3752-4f5d-8dd2-ef33c9f98c3b req-7e096134-587f-4005-88e9-e6286fa56dd7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.325082 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-d226ffd1-3752-4f5d-8dd2-ef33c9f98c3b req-7e096134-587f-4005-88e9-e6286fa56dd7 service nova] Creating event network-vif-plugged:881f218e-3373-430b-89cc-fb0562f0fcfd for instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb on hv-cinder-75510 May 11 19:00:26.334922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-d226ffd1-3752-4f5d-8dd2-ef33c9f98c3b req-7e096134-587f-4005-88e9-e6286fa56dd7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054503 May 11 19:00:26.334922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 233/458] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:26.434566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:26.435275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:26.442492 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.442947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.443761 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.444457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.495636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.505597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8e2923ba-99b0-4f09-a999-e8324d490897 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.239132 May 11 19:00:26.506863 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 226/459] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:26 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:26.590136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.598827 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.600706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.602175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3b3a4810-2f29-4d3a-9e6a-1e58d614355a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.171961 May 11 19:00:26.602850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 234/460] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:26 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:26.626285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:26.627691 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:26.636480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.639887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.640962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.641625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.725397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:26.726383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:26.733447 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.733918 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.734678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:26.735123 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:26.808595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.823495 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b0bcab13-924c-467b-b591-53daf3dec084 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.201052 May 11 19:00:26.824516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 227/461] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:26 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:26.883753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:26.892073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-17a8aed5-d4fb-4b6f-a298-546f8559d393 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.170687 May 11 19:00:26.893480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 235/462] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:26 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:27.074445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:27.075902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:27.088637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.089283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.090224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.090840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.253131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:27.261770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cd31c46d-c704-4778-9fef-b4da1ff1b39c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.191808 May 11 19:00:27.271966 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 228/463] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:27 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:27.523596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:27.524909 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:27.532820 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.534396 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.535588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.536372 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.621859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:27.622540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:27.629420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.629873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.630656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.631091 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.749718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:27.761681 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3c8c1a99-eb7c-429d-990b-a717463975f4 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.242864 May 11 19:00:27.763460 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 236/464] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:27 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:27.843323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:27.848055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:27.849672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:27.855540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:27.856724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.857367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.858358 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.858950 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.859604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:27.861002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1d2ee3f4-b776-4d49-b8cf-00cac27d0b41 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.243215 May 11 19:00:27.862010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 229/465] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:27 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:27.909463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:27.910245 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:27.916723 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.917534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:27.918563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:27.919233 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.027252 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:28.036561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-72fe3493-88e1-4f34-8b15-711ea4e64f38 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.199137 May 11 19:00:28.038184 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 237/466] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:27 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:28.092840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:28.100990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1c7ff25c-feea-4b9c-a5eb-53f27bf4a60a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.195285 May 11 19:00:28.101557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 230/467] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:27 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:28.279658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:28.280247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:28.286259 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:28.286718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.287518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:28.287958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.430139 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:28.438506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-318ab49f-2b6b-42c5-8307-6a10e7936fc5 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.162721 May 11 19:00:28.439997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 238/468] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:28 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:28.781684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:28.782255 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:28.805985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:28.806441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.807259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:28.807699 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.879548 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:28.880164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:28.887243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:28.887775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.888611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:28.889048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:28.986473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:28.993909 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-125aeac8-028a-42f5-93d3-955f3aaf6cd2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.216603 May 11 19:00:28.994743 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 231/469] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:28 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:29.054070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:29.054734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:29.063646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:29.064301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:29.065104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:29.065248 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:29.065911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:29.077639 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:29.079542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:29.081877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-18ea33ed-9c82-40c2-9251-0d3556eca431 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.206312 May 11 19:00:29.091390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 239/470] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:28 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:29.118271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:29.119042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:29.125324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:29.125858 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:29.126746 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:29.127260 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:29.231853 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:29.240148 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-06bfb56a-3c24-4d5f-b1f7-5d00285948f2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.189938 May 11 19:00:29.241119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 232/471] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:29 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:29.294836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:29.302125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8792a0dc-067c-4385-8790-36e1198ccf0d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.188343 May 11 19:00:29.302683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 240/472] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:29 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:29.457888 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:29.458752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:29.465041 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:29.465490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:29.466270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:29.466706 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:29.616741 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:29.624469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-45cbd074-4cc2-4a72-bbd0-7500685f3d68 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.171622 May 11 19:00:29.625157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 233/473] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:29 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:30.015822 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:30.016618 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:30.025616 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.026062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.026832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.027264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.101444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:30.102133 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:30.114514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.114514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.115192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.115649 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.170692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.178730 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-de52d5cb-2bd1-4b68-bdc5-04af168e6291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.166856 May 11 19:00:30.179661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 241/474] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:30 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:30.253936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.257409 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:30.257565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:30.262729 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.263442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.263898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.264386 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.264677 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.265114 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.265818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d11aecaa-f729-4ddf-a637-ad7aeb4de8da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.168582 May 11 19:00:30.275436 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 234/475] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:30 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:30.319037 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:30.319973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:30.326045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.327918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.328804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.329315 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.404505 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.415666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d13376f9-d685-410c-8339-b70d85e51cff tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.162439 May 11 19:00:30.416254 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 242/476] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:30 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:30.483079 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.490331 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0d3012e5-04fb-4e17-a8dd-4589d7b87c11 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.175172 May 11 19:00:30.490894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 235/477] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:30 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:30.640812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:30.641625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:30.648179 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.648705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.649513 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:30.649966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:30.791161 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:30.799989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f39f3692-8436-4ea9-b0f4-e1dad8266c1e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.162862 May 11 19:00:30.800668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 243/478] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:30 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:31.196285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:31.197002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:31.203911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.204460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.205299 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.205804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.284275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:31.284874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:31.291946 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.292392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.293137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.293573 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.345376 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.354487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0e9bf264-e053-49b7-b413-885da7d9d1bb tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.162253 May 11 19:00:31.355074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 236/479] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:31 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:31.433854 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:31.434522 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:31.434954 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.441143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.441631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.442398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.442831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.443325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.445116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.446470 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-310bb008-71be-4feb-b8bd-f56183117a29 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.165982 May 11 19:00:31.447034 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 244/480] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:31 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:31.506707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:31.507347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:31.513201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.513651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.514420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.514853 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.579282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.588652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cafe4f83-a9ac-4380-a9b1-eba8d48f7d6e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.159590 May 11 19:00:31.589472 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 237/481] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:31 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:31.651753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.659722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-216e2170-b9d3-40bd-8fa1-3a7add757b41 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.156942 May 11 19:00:31.660282 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 245/482] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:31 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:31.817275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:31.817881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:31.824277 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.824724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.825493 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:31.825927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:31.964438 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:31.974289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c0f2b1a6-e162-4c8b-9442-b38cb28e45da tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.160763 May 11 19:00:31.983363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 238/483] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:31 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:32.371801 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:32.372410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:32.378694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.379141 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.379948 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.380375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.465492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:32.466104 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:32.472790 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.473238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.474008 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.474447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.520222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:32.527874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-18b391b1-b8a5-4a79-b3ab-66b2687d761f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.159879 May 11 19:00:32.528541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 246/484] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:32 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:32.606438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:32.607205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:32.607605 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:32.614175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.614699 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.615599 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.616104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.616602 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:32.618105 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:32.619266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fe6c3f96-77b2-4e79-a3b0-36b5dd9225d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.157772 May 11 19:00:32.624857 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 239/485] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:32 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:32.675835 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:32.676532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:32.682422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.682877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.683697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.684136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.748017 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:32.755196 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-56183181-96f9-4f5e-8318-cca1f6ecd44a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.153139 May 11 19:00:32.756067 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 247/486] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:32 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:32.818283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:32.825908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8838591b-b58d-49be-886f-bbd439139ab7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.153947 May 11 19:00:32.826465 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 240/487] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:32 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:32.991038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:32.991698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:32.997836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.998231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:32.998994 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:32.999475 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.131813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.140521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9697ef75-d2d3-4368-b37d-b91019a20eb0 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.153228 May 11 19:00:33.141101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 248/488] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:32 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:33.546034 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:33.546820 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:33.554246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.554796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.555618 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.556064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.638288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:33.638925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:33.645986 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.646410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.647209 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.647679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.690944 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.698507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-20540b65-08eb-4fc3-8ce7-bab106d48a68 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.156438 May 11 19:00:33.699265 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 241/489] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:33 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:33.772351 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:33.773548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:33.779837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.780347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.781169 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.781667 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.793729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.802638 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.804167 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.805349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9f254c11-b1cc-45bc-b3b2-02d1e1d545da tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1738 microversion: 2.20 time: 0.171035 May 11 19:00:33.805910 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 249/490] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:33 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:33.843666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:33.844332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:33.851061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.852542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.852542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:33.852747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:33.920984 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.929887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-df7642c7-6524-471f-860a-22a1ac27e277 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.161289 May 11 19:00:33.930612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 242/491] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:33 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:33.984243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:33.992890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6061a629-3e6d-4072-a046-17b24c3f10af tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.153196 May 11 19:00:33.993515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 250/492] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:33 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:34.159109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:34.160109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:34.166049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.166609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.167481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.168121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.317564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:34.325738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-33a554e9-fbc5-43ad-9e09-e969acd9948c tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.171833 May 11 19:00:34.326379 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 243/493] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:34 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:34.494502 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-6ddb31f9-e5b8-412f-a7e3-283fa1beb881 req-fb32584b-d432-4dac-a0be-5214a0a2a01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "name": "network-vif-unplugged", "status": "completed", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:34.503440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-6ddb31f9-e5b8-412f-a7e3-283fa1beb881 req-fb32584b-d432-4dac-a0be-5214a0a2a01e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.503981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-6ddb31f9-e5b8-412f-a7e3-283fa1beb881 req-fb32584b-d432-4dac-a0be-5214a0a2a01e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.516497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-6ddb31f9-e5b8-412f-a7e3-283fa1beb881 req-fb32584b-d432-4dac-a0be-5214a0a2a01e service nova] Creating event network-vif-unplugged:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 19:00:34.523200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-6ddb31f9-e5b8-412f-a7e3-283fa1beb881 req-fb32584b-d432-4dac-a0be-5214a0a2a01e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033712 May 11 19:00:34.523900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 251/494] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:00:34.715322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:34.715949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:34.722367 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.722822 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.723646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.724089 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.824446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:34.825143 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:34.836430 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.836917 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.839515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.845149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.943903 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:34.951554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a2445c63-3910-4f27-a14b-f453a04f8439 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.240016 May 11 19:00:34.959358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 244/495] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:34 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:34.959358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:34.959358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:34.963194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.963681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:34.964456 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:34.964902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:35.004253 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:35.012126 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:35.013641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:35.014814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2e2aa217-b483-4328-b3f3-a969715df89f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.194720 May 11 19:00:35.019336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 252/496] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:34 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:35.020265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:35.020864 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:35.026775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:35.027240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:35.028053 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:35.028499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:35.100910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:35.109295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4689a111-06d8-436f-92a1-406b4804ed31 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.155941 May 11 19:00:35.109882 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 245/497] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:34 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:35.182034 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:35.189968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e2cdcb68-f5ed-40e3-b268-9baacf9bbc85 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.173103 May 11 19:00:35.190523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 253/498] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:35 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:35.341939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:35.342547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:35.349237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:35.349629 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:35.350389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:35.350823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:35.487542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:35.495877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-944599e7-e34e-4520-b41c-97a1a3d0c1bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.157539 May 11 19:00:35.496449 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 246/499] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:35 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:35.967923 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:35.968537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:35.975475 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:35.975929 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:35.976693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:35.977134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.033559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:36.034173 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:36.040685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.041137 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.041919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.042540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.123136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.133430 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ffbfc12e-2fd6-425e-84fd-4248c31ee37e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.168998 May 11 19:00:36.134609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 254/500] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:35 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:36.145312 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:36.145924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:36.151964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.152417 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.153193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.153635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.211289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.224487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.226310 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.227707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-943bf568-c2a3-45f9-a368-ff49b3a4d732 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.197988 May 11 19:00:36.228806 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 247/501] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:36 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:36.235203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:36.236739 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:36.246492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.247526 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.248544 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.249195 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.315032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.322747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3a82df6e-2a83-4acb-bccf-dbdb263b73d2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.181807 May 11 19:00:36.323344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 255/502] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:36 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:36.387671 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.395024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0650cdaf-82e1-4bcf-ba42-43bef2d62239 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.165023 May 11 19:00:36.395635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 248/503] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:36 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:36.511947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:36.512557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:36.520857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.521492 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.522302 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:36.522740 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:36.666911 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:36.674814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b2cfdf6c-f97f-4f83-9e50-017924a9ffb8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.166739 May 11 19:00:36.675404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 256/504] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:36 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:37.149804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:37.150437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:37.156778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.157230 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.158654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.159093 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.246220 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:37.246721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:37.253030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.254099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.255078 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.255687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.295712 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.303341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a80cb1c2-b1da-4015-a0a2-fb97b6927679 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.157538 May 11 19:00:37.311347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 249/505] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:37 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:37.340883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:37.341696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:37.349130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.349575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.350345 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.350781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.464883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.473832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.475410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.476594 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cdb41dbf-f9fd-453e-be11-dbbfaad841e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.234535 May 11 19:00:37.477154 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 257/506] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:37 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:37.491130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4e96a8e3-b235-42b0-b2c1-3f488c62df93 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:37.505844 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e96a8e3-b235-42b0-b2c1-3f488c62df93 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.506308 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e96a8e3-b235-42b0-b2c1-3f488c62df93 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.514186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.529730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-544d5f73-6b4a-40b1-9237-9dc4693c168f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.193039 May 11 19:00:37.530594 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 250/507] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:37 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:37.536254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:37.537048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:37.545834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.546339 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.547810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.548588 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.585736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4e96a8e3-b235-42b0-b2c1-3f488c62df93 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Going to try to stop instance {{(pid=117097) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 19:00:37.636429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4e96a8e3-b235-42b0-b2c1-3f488c62df93 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action" status: 202 len: 0 microversion: 2.1 time: 0.157753 May 11 19:00:37.637111 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 258/508] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:00:37 2022] POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:00:37.648972 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:37.649603 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:37.656537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.656993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.657937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.658384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.705192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.713646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4ce840f3-6575-4418-899e-95eb66e28a3b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.182020 May 11 19:00:37.714227 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 251/509] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:37 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:37.718694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:37.719305 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:37.726011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.726464 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.727237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:37.727727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:37.849215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.857061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-621f6903-1893-497a-877e-f7e9ee00b807 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.212309 May 11 19:00:37.857646 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 259/510] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:37 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:37.861315 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:37.868672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c2b4eb94-7871-4313-af00-58674dbfdb24 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1371 microversion: 2.1 time: 0.153499 May 11 19:00:37.869235 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 252/511] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:37 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:38.181577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-cbbe3ba7-8f8a-46d0-9781-7876b3d6cdd8 req-0b31fedd-c6a9-4ed4-83f0-f7258d763736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "name": "network-vif-plugged", "status": "completed", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:38.190451 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-cbbe3ba7-8f8a-46d0-9781-7876b3d6cdd8 req-0b31fedd-c6a9-4ed4-83f0-f7258d763736 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.190972 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-cbbe3ba7-8f8a-46d0-9781-7876b3d6cdd8 req-0b31fedd-c6a9-4ed4-83f0-f7258d763736 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.212928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-cbbe3ba7-8f8a-46d0-9781-7876b3d6cdd8 req-0b31fedd-c6a9-4ed4-83f0-f7258d763736 service nova] Creating event network-vif-plugged:c94167a9-9991-43a1-8fe8-7f90f0e5fd82 for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b on hv-cinder-75510 May 11 19:00:38.219811 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-cbbe3ba7-8f8a-46d0-9781-7876b3d6cdd8 req-0b31fedd-c6a9-4ed4-83f0-f7258d763736 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041763 May 11 19:00:38.221193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 260/512] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:00:38.320839 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:38.321668 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:38.328308 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.328697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.331492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.331492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.481157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:38.489497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4d547caa-4070-43a5-8c2d-644299ddaf72 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.172750 May 11 19:00:38.490271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 253/513] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:38 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:38.496419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:38.497910 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:38.505672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.506197 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.507058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.507627 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.546899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:38.548009 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:38.555537 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.555996 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.556791 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.557296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.643453 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:38.652612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:38.654195 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:38.655465 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-81f90342-bf78-4e1a-91bb-7f83d15fe509 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.163161 May 11 19:00:38.656100 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 261/514] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:38 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:38.691462 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:38.699191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ba2bd31a-34bd-4e8e-96f5-585f5503317e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.157036 May 11 19:00:38.699784 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 254/515] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:38 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:38.730527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:38.731174 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:38.737349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.737805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.738581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.739022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.867343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:38.874347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:38.875027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7aa449b6-7c50-426f-a1ef-c0b4de31ff07 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.148192 May 11 19:00:38.875249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:38.878080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 262/516] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:38 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:38.882809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.883465 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.884440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.884880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.886476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:38.887086 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:38.896664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.896664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:38.896664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:38.896664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.025399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.038248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.042117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9a4a7acc-54de-4789-ab96-6f4c81d1b938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.171490 May 11 19:00:39.042716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 255/517] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:38 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:39.047062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b6f635ff-8a5e-4536-8cff-2697088e6041 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1564 microversion: 2.1 time: 0.164891 May 11 19:00:39.047889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 263/518] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:38 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:39.066477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:39.067007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:39.074141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.074604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.075409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.075882 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.156753 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a8a3db21-ab18-4c02-8ca9-2ab001569f79 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094849 May 11 19:00:39.157353 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 256/519] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 19:00:39 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:39.506441 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:39.507134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:39.513752 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.514201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.514985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.515454 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.645997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.653642 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aaabb23a-5007-40a1-af52-2147d3f1a665 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.151157 May 11 19:00:39.654226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 264/520] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:39 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:39.674959 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:39.675620 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:39.681571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.682015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.682779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.683209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.717664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:39.718623 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:39.725921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.726470 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.727336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.728041 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.878987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.886680 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8262ba29-139a-4c52-a840-d2dbc6694dc2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.173993 May 11 19:00:39.887004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 265/521] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:39 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:39.891491 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:39.892531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:39.898591 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.899037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.899830 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:39.900263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:39.911101 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.920014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.922558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:39.923823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8faec0db-6456-4662-88e3-9339edb865b1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.253371 May 11 19:00:39.924571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 257/522] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:39 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:40.032584 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:40.039898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-73c63fa6-e7f3-4548-804b-b611b74acfc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.151901 May 11 19:00:40.040467 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 266/523] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:39 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:40.059425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:40.060268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:40.066667 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.067119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.067910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.068344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.249330 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-813b952b-c8c1-4139-a548-7fad9bc2219e req-c8262cfe-4ec0-40bd-8b0d-4ab20407fedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566e7940-0d8b-421c-87de-d7fc5c7db98a", "name": "network-vif-plugged", "status": "completed", "tag": "e43aea4f-9550-41a9-8237-a44c594c43ea"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:40.259407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-813b952b-c8c1-4139-a548-7fad9bc2219e req-c8262cfe-4ec0-40bd-8b0d-4ab20407fedd service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.259973 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-813b952b-c8c1-4139-a548-7fad9bc2219e req-c8262cfe-4ec0-40bd-8b0d-4ab20407fedd service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.276004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-813b952b-c8c1-4139-a548-7fad9bc2219e req-c8262cfe-4ec0-40bd-8b0d-4ab20407fedd service nova] Creating event network-vif-plugged:e43aea4f-9550-41a9-8237-a44c594c43ea for instance 566e7940-0d8b-421c-87de-d7fc5c7db98a on hv-cinder-75510 May 11 19:00:40.277561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-813b952b-c8c1-4139-a548-7fad9bc2219e req-c8262cfe-4ec0-40bd-8b0d-4ab20407fedd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031989 May 11 19:00:40.278608 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 267/524] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:00:40.291318 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:40.300153 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-579a2bc7-09dc-4405-aac3-e69ca14a7dcc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.244565 May 11 19:00:40.309527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-3525ac65-3c63-43ee-a708-1132c8818c37 req-63cc1a6b-b4e0-4189-a5ed-4158bf909bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73aaf5-ec3f-4e29-8e67-597130c372fb", "tag": "881f218e-3373-430b-89cc-fb0562f0fcfd"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:40.309894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 258/525] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:40 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:40.318905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-3525ac65-3c63-43ee-a708-1132c8818c37 req-63cc1a6b-b4e0-4189-a5ed-4158bf909bd7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.319702 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-3525ac65-3c63-43ee-a708-1132c8818c37 req-63cc1a6b-b4e0-4189-a5ed-4158bf909bd7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.333213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-3525ac65-3c63-43ee-a708-1132c8818c37 req-63cc1a6b-b4e0-4189-a5ed-4158bf909bd7 service nova] Creating event network-changed:881f218e-3373-430b-89cc-fb0562f0fcfd for instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb on hv-cinder-75510 May 11 19:00:40.338591 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-3525ac65-3c63-43ee-a708-1132c8818c37 req-63cc1a6b-b4e0-4189-a5ed-4158bf909bd7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032954 May 11 19:00:40.339923 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 268/526] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:00:40.670691 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:40.671316 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:40.677679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.678296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.678890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.679349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.809453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:40.817178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3eb4f344-a701-4110-9263-117d9db09785 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.150405 May 11 19:00:40.817741 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 259/527] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:40 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:40.904497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:40.905144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:40.911893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.912338 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.913093 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.913523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.942754 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:40.943532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:40.955412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.956457 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:40.957324 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:40.958389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.065977 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.073706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5569ef3c-0116-4543-b718-ebb37c11fe3f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.173313 May 11 19:00:41.074474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 269/528] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:40 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:41.079529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:41.079985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:41.085869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:41.086327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.087108 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:41.087584 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.111197 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.119423 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.120933 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.122086 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-61c875f1-d1e9-4e14-a41b-542eda419fe0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.184069 May 11 19:00:41.122640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 260/529] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:40 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:41.241968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.253069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3765d692-80a1-4a88-91a5-9aa8bb44c692 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.177722 May 11 19:00:41.253658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 270/530] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:41 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:41.317285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:41.317808 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:41.323946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:41.324398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.325163 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:41.325600 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.495909 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.504852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-dc28bea7-c500-4b4e-b800-ea6973115e19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.191510 May 11 19:00:41.505740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 261/531] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:41 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:41.833923 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:41.834546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:41.840841 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:41.841514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.842282 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:41.842718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:41.972593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:41.980008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6a9474f6-efca-47f6-98cb-5c938127f46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.149850 May 11 19:00:41.980571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 271/532] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:41 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:42.089991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:42.090584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:42.098260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.098717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.099519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.099960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.140567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:42.141190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:42.156033 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.156516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.159428 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.160273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.271845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:42.283549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-070cc7f6-29d4-46b2-aacf-59e6af12ae07 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.197316 May 11 19:00:42.289670 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 262/533] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:42 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:42.303796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:42.306237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:42.312500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.313068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.313956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.314457 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.453182 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:42.466622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:42.469055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:42.471703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-904f520e-ccf7-4247-b981-e3983c76e6f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1720 microversion: 2.20 time: 0.335267 May 11 19:00:42.478340 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 272/534] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:42 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1720 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:42.483959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-adcd73e4-e55a-4a82-9e3e-75c38eccf111 req-859e3ae0-dafc-425b-a03d-20ecdce0adbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "name": "network-vif-plugged", "status": "completed", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:42.491285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:42.493925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-adcd73e4-e55a-4a82-9e3e-75c38eccf111 req-859e3ae0-dafc-425b-a03d-20ecdce0adbd service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.494714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-adcd73e4-e55a-4a82-9e3e-75c38eccf111 req-859e3ae0-dafc-425b-a03d-20ecdce0adbd service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.504839 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-39cea11e-6674-4f6d-ae80-4260fc9e1ce4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.204291 May 11 19:00:42.505427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 263/535] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:42 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:42.511631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-adcd73e4-e55a-4a82-9e3e-75c38eccf111 req-859e3ae0-dafc-425b-a03d-20ecdce0adbd service nova] Creating event network-vif-plugged:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:00:42.517603 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-adcd73e4-e55a-4a82-9e3e-75c38eccf111 req-859e3ae0-dafc-425b-a03d-20ecdce0adbd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036402 May 11 19:00:42.518847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 273/536] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:42.537288 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:42.538110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:42.549838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.550839 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.552350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:42.553246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:42.687064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:42.695178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-04699018-b571-4b16-97e0-9a68ec509dbf tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.170498 May 11 19:00:42.695775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 264/537] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:42 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:42.998716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:42.999344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:43.006537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.006988 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.007805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.008246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.136157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.143564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-40f217b9-d2f8-4532-b48e-a4cfac00788a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.149532 May 11 19:00:43.144179 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 274/538] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:42 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:43.306066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:43.306628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:43.313063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.313520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.314866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.315333 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.465074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.473921 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e6aa519f-682e-4486-9bf5-87ac099b94ab tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.171695 May 11 19:00:43.474688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 265/539] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:43 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:43.490125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:43.490952 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:43.497538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.497985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.499136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.499733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.522446 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:43.523603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:43.532895 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.533498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.534288 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.534729 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.639032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.649342 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.651003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.652228 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4e40db6f-6866-4090-a9dd-c82adbe0d65b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1723 microversion: 2.20 time: 0.165985 May 11 19:00:43.652737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 275/540] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:43 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:43.672255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d68c6f-3792-449a-b7e0-6cc5d0608927"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:43.674485 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:43.680650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.681177 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.682448 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.682886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.692180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.701130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b04c00cb-38cb-4392-b8b7-0c336c3755c0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.182726 May 11 19:00:43.702327 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 266/541] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:43 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:43.715056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:43.716554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:43.723705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.724159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.724911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:43.725415 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:43.865919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:43.874951 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-36f32486-c81f-4098-b740-0f42e9ed1bde tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.165069 May 11 19:00:43.875660 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 267/542] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:43 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:44.020838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-33684f25-57dd-4d05-bca6-f32f995b03ee tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354330 May 11 19:00:44.021759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 276/543] 10.222.0.93 () {62 vars in 1363 bytes} [Wed May 11 19:00:43 2022] POST /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 19:00:44.132583 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:44.133171 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:44.139077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.139555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.140309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.140857 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.161814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:44.162492 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:44.169157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.169612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.170513 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.170963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.233380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b111078f-8a9c-4844-8f11-e000345cdb1c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/action" status: 202 len: 0 microversion: 2.20 time: 0.104770 May 11 19:00:44.234274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 268/544] 10.222.0.93 () {62 vars in 1318 bytes} [Wed May 11 19:00:44 2022] POST /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 19:00:44.242859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:44.243515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:44.249662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.250272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.251051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.251523 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.312764 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:44.320445 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-eb8b4e86-1d33-4199-a868-b3ff573f23c1 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.163710 May 11 19:00:44.321020 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 277/545] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:44 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:44.391908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:44.400292 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:44.401807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:44.403028 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-68b8467f-18af-4a30-beb2-880cc5247e2d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1809 microversion: 2.20 time: 0.164102 May 11 19:00:44.403625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 269/546] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:44 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:44.491740 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:44.492896 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:44.499709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.500221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.500995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.501429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.647527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:44.656190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-09d6f0bd-b398-49b2-b191-b25015fb88dc tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1258 microversion: 2.1 time: 0.168759 May 11 19:00:44.657016 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 278/547] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:44 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:44.717995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:44.718596 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:44.725198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.725651 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.726401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.726829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.860792 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:44.868202 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a8e499ca-4f7a-4c8e-8d5a-8baa5d6f6e62 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.154055 May 11 19:00:44.868770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 270/548] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:44 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:44.892931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:44.893530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:44.899776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.900515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:44.901527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:44.901971 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.048180 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.056012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a05eaff2-c7a3-4c11-9f87-8c8f58a775e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.167477 May 11 19:00:45.056584 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 279/549] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:44 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:45.336559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:45.337160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:45.343908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.344352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.345124 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.345557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.421963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:45.422744 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:45.429867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.430394 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.431498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.432004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.488751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.496178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e1fb3aaf-5961-4b59-bb04-a9a725b4698a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.163511 May 11 19:00:45.496752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 271/550] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:45 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:45.564999 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.573588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.575070 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.576277 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-18073772-9b8d-4cbc-989c-9df95babf1dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1749 microversion: 2.20 time: 0.158233 May 11 19:00:45.576826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 280/551] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:45 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:45.674168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:45.674722 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:45.680934 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.681375 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.682135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.682562 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.816139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.823860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7aa7dfed-f10b-4ffc-ad92-8eba00d3255e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1442 microversion: 2.1 time: 0.154103 May 11 19:00:45.824418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 272/552] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:45 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:45.839610 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:45.840219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:45.847210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.847686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.848459 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.848894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.884949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:45.885553 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:45.891728 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.892063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.892823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:45.893254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:45.983017 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:45.990534 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b4145cfb-a539-421a-bd03-19cb4866614a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1442 microversion: 2.1 time: 0.154794 May 11 19:00:45.991130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 281/553] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:45 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:46.023591 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:46.030548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-02284f6d-8e06-42c0-8f7e-72354a3bf3bc tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.149320 May 11 19:00:46.031114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 273/554] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:45 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:46.073857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:46.074462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:46.081007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:46.081456 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:46.082218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:46.082648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:46.239278 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:46.247198 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8e78c51c-928d-41d8-bb43-f0df92fc6760 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.177274 May 11 19:00:46.247821 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 282/555] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:46 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:46.513435 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:46.514111 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:46.520453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:46.520907 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:46.521943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:46.522418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:46.594412 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:46.595881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:46.603708 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:46.604150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:46.605205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:46.605455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:46.753384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:46.764753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:46.766443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:46.767913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-af47ba0a-7cc1-4414-bcbf-65c287c916e5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1749 microversion: 2.20 time: 0.177594 May 11 19:00:46.768970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 283/556] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:46 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:46.987007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:46.994697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e5fa8e62-e535-4091-b248-97efb22d9d87 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.485114 May 11 19:00:46.995382 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 274/557] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:46 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:47.047765 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:47.048317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:47.054215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:47.054669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:47.055490 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:47.055954 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:47.189127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:47.196726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f70b2fcc-0958-47fa-af15-1555e0775db1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.152910 May 11 19:00:47.197289 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 284/558] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:47 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:47.264950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:47.265670 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:47.272135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:47.272588 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:47.273665 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:47.273821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:47.486704 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:47.494570 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a936e56b-3190-4d5a-9538-586ad73dc885 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.233559 May 11 19:00:47.495145 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 275/559] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:47 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:47.787382 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:47.788020 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:47.797482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:47.798441 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:47.799212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:47.799694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:47.927060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:47.936058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:47.937753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:47.940499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-08b5dbc8-2887-46ef-9532-6830d1fd04a2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1749 microversion: 2.20 time: 0.156779 May 11 19:00:47.941575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 285/560] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:47 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:48.011349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:48.011965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:48.018234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.018687 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.019497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.019940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.214628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:48.215233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:48.221615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.222071 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.222884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.223535 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.226116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:48.234027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fe9bc89b-a65d-4178-a232-913d2a8bc03a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.226579 May 11 19:00:48.234834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 276/561] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:48 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:48.247625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-8100526c-ca13-45a6-8e7f-9032c881c61f req-4bc7be33-93fe-4edf-b0bf-899c2f95fddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:48.257485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-8100526c-ca13-45a6-8e7f-9032c881c61f req-4bc7be33-93fe-4edf-b0bf-899c2f95fddf service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.258021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-8100526c-ca13-45a6-8e7f-9032c881c61f req-4bc7be33-93fe-4edf-b0bf-899c2f95fddf service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.271358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-8100526c-ca13-45a6-8e7f-9032c881c61f req-4bc7be33-93fe-4edf-b0bf-899c2f95fddf service nova] Creating event network-changed:c94167a9-9991-43a1-8fe8-7f90f0e5fd82 for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b on hv-cinder-75510 May 11 19:00:48.276626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-8100526c-ca13-45a6-8e7f-9032c881c61f req-4bc7be33-93fe-4edf-b0bf-899c2f95fddf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033013 May 11 19:00:48.277678 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 277/562] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:00:48.357102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:48.365018 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ac99c3ff-5ba9-4207-852e-184f3d8a59e3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.154718 May 11 19:00:48.365841 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 286/563] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:48 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:48.513450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:48.514149 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:48.523290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.523896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.524886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.525343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.698659 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:48.706558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-62b72a6a-cd93-4b85-9937-85802f6e456b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.198230 May 11 19:00:48.707132 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 278/564] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:48 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:48.959310 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:48.959934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:48.966211 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.966661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:48.967463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:48.967959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.100887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:49.109721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:49.111845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:49.113064 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-50383995-af1f-44f7-97f4-3151264bbe1b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1751 microversion: 2.20 time: 0.157693 May 11 19:00:49.113669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 287/565] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:48 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:49.255617 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:49.256231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:49.262563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:49.263140 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.263831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:49.264272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.381940 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:49.382525 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:49.388464 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:49.389164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.389941 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:49.390380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.401412 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:49.410678 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a3b08002-98b0-442c-9623-e101b04532fa tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.159079 May 11 19:00:49.415793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 279/566] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:49 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:49.524010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:49.531579 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-041729f4-f2c8-4e1c-bb5d-fd3315f63f5e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1367 microversion: 2.1 time: 0.153439 May 11 19:00:49.532156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 288/567] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:49 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:49.724427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:49.725056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:49.731633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:49.732094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.733031 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:49.733470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:49.879397 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:49.887814 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-14117ca4-6c53-41e0-a658-6db8bcd55448 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.167922 May 11 19:00:49.888583 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 280/568] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:49 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:50.131746 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:50.132348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:50.138611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.139062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.139851 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.140289 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.266651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:50.275263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:50.276800 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:50.278001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1e78fe96-8d3b-42f8-961e-b2be265019a8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1751 microversion: 2.20 time: 0.150208 May 11 19:00:50.278555 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 289/569] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:50 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:50.428736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:50.429349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:50.435781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.436233 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.437000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.437437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.548783 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:50.549387 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:50.555425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.555882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.556656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.557132 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.563860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:50.572477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5b922e9b-61b4-4314-9d5e-1a9779383ae6 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.147641 May 11 19:00:50.573138 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 281/570] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:50 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:50.765281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:50.773095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d4274daa-5e5c-4533-aaee-07d4c43ea0ad tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1556 microversion: 2.1 time: 0.228753 May 11 19:00:50.773652 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 290/571] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:50 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:50.789886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:50.790377 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:50.796310 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.796759 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.797514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.797976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.911613 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ec9ea54f-dece-4e53-b5bb-58f3a0564653 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123962 May 11 19:00:50.912565 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 282/572] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 19:00:50 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:50.918483 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:50.918483 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:50.930124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.931089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:50.934273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:50.935167 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:51.187604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:51.196273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-419c8c41-df04-4043-9bb6-a988ed2a307c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.294766 May 11 19:00:51.196847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 291/573] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:50 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:51.299918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:51.300669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:51.307655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:51.308189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:51.308981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:51.309422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:51.532545 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:51.540855 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:51.542469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:51.543903 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-af7f21a8-9b19-4f4a-abb4-1a1e615483d0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1751 microversion: 2.20 time: 0.251062 May 11 19:00:51.544487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 283/574] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:51 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1751 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:00:51.589271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:51.589800 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:51.596079 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:51.596776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:51.597582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:51.598009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:51.777831 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:51.786284 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fe0f1fef-97ca-4d4b-8cf4-213e4d29a46b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.200818 May 11 19:00:51.786880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 292/575] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:51 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:52.214579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:52.215291 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:52.222261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.222719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.223542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.224019 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.460481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:52.476183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ae3714f2-8a55-4c9f-8ef0-ba8d9829487b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.265279 May 11 19:00:52.487646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 284/576] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:52 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:52.508688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-c1c0de5b-3fc2-4c1e-8b4d-da257e9631ae req-8117b20c-fa4e-4d32-93c5-4af34167aa14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566e7940-0d8b-421c-87de-d7fc5c7db98a", "tag": "e43aea4f-9550-41a9-8237-a44c594c43ea"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:52.526266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-c1c0de5b-3fc2-4c1e-8b4d-da257e9631ae req-8117b20c-fa4e-4d32-93c5-4af34167aa14 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.526712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-c1c0de5b-3fc2-4c1e-8b4d-da257e9631ae req-8117b20c-fa4e-4d32-93c5-4af34167aa14 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.538485 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-c1c0de5b-3fc2-4c1e-8b4d-da257e9631ae req-8117b20c-fa4e-4d32-93c5-4af34167aa14 service nova] Creating event network-changed:e43aea4f-9550-41a9-8237-a44c594c43ea for instance 566e7940-0d8b-421c-87de-d7fc5c7db98a on hv-cinder-75510 May 11 19:00:52.543906 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-c1c0de5b-3fc2-4c1e-8b4d-da257e9631ae req-8117b20c-fa4e-4d32-93c5-4af34167aa14 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038809 May 11 19:00:52.544514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 293/577] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:52.564931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:52.565703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:52.575524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.584286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.585734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.586535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.738031 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:52.747021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:52.748561 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:52.751321 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-72668dd9-fdd6-49ab-9e5c-690ca0d9459e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1751 microversion: 2.20 time: 0.190318 May 11 19:00:52.752480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 285/578] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:52 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:52.806415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:52.808201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:52.818630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.819787 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.820854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:52.821761 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:52.994225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:53.001640 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0872d20c-fb44-4e2e-86f1-59d9b9aa0c4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1357 microversion: 2.1 time: 0.201773 May 11 19:00:53.002137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 294/579] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:52 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:53.493811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:53.494603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:53.501940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:53.502473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:53.503330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:53.503949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:53.634829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:53.643416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a14650b5-a280-4ad9-92eb-dd89e383878e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.153764 May 11 19:00:53.644001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 286/580] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:53 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:53.779184 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:53.780081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:53.787706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:53.788235 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:53.789234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:53.789830 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:53.977655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:53.986667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:53.988210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:53.989426 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-687cf1d5-59fa-4ac8-80fc-c3c8e9dab85a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.224044 May 11 19:00:53.989990 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 295/581] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:53 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:54.018247 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:54.018883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:54.024794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.025418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.026191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.026880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.190330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:54.197891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0b29fb82-8c58-41ce-967a-0da6c2f03673 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1547 microversion: 2.1 time: 0.183814 May 11 19:00:54.198462 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 287/582] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:54 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:54.214692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:54.215650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:54.222271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.222719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.223510 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.223946 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.350839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:54.358403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5a40dad3-9419-47a8-a323-1d7f59cbe291 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1547 microversion: 2.1 time: 0.147713 May 11 19:00:54.358981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 296/583] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:54 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:54.374296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:54.377846 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:54.378664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Searching by: {'deleted': False, 'project_id': '4be93dc182224cfe8be43a23dadbb62f'} {{(pid=117096) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 11 19:00:54.385196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.385639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.386434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.386871 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.479235 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.multi_cell_list [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117096) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 11 19:00:54.578252 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f6e7c538-068d-424f-83d3-72ccbc2ce956 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207597 May 11 19:00:54.579363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 288/584] 10.222.0.93 () {58 vars in 1124 bytes} [Wed May 11 19:00:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:00:54.589390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:54.590075 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:54.596742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.597191 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.597958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.598451 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.661136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:54.661743 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:54.667666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.668114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.668871 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:54.669395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:54.789278 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:54.797638 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4b0cc419-ed4e-4a03-ae38-1317a0bac15f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1547 microversion: 2.1 time: 0.212013 May 11 19:00:54.798378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 297/585] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:54 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1547 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:54.882026 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:54.893964 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-79ee880b-b8fa-462d-a8d6-0d35ad1530e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.237180 May 11 19:00:54.894717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 289/586] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:54 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:00:55.009591 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:55.010466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:55.017794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:55.018247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:55.019023 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:55.019488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:55.174299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:55.183068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:55.184711 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:55.185858 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-509a9338-943a-41a7-9358-007071002882 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.181581 May 11 19:00:55.186405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 298/587] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:55 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:55.911790 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:55.912396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:55.918992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:55.919480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:55.920255 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:55.920697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:56.145422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:56.153434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a15e6018-4f07-4f85-a495-72acc64972d2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.245972 May 11 19:00:56.154002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 290/588] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:55 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:56.205940 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:56.207568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:56.214026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:56.214484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:56.215265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:56.215743 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:56.347141 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:56.355616 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:56.357107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:56.358343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-954f90dc-85d7-4502-94a3-742e1915ebd5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.157532 May 11 19:00:56.358902 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 299/589] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:56 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:57.169836 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:57.170424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:57.176794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:57.177237 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:57.177995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:57.178426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:57.316955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:57.324959 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-21526066-f9d0-4ac3-9da6-989f57cccd8a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.158991 May 11 19:00:57.325519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 291/590] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:57 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:57.376710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:57.377306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:57.383914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:57.384364 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:57.385130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:57.385563 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:57.515096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:57.523503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:57.524997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:57.526186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1fb5fe01-cddc-4e6b-a7b9-2e549bbfbafa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.153826 May 11 19:00:57.526749 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 300/591] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:57 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:58.341943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:58.342552 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:58.349361 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:58.349811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:58.350761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:58.351197 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:58.480440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:58.488270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-55b587da-21ef-4bdf-82e8-89b917ca6df4 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.150122 May 11 19:00:58.488844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 292/592] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:58 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:58.544375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:58.544984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:58.552728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:58.553194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:58.553995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:58.554433 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:58.745747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:58.763208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:58.765030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:58.766257 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-64a9d0dc-c725-40da-ac33-151685fe8e52 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.225864 May 11 19:00:58.767375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 301/593] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:58 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:00:59.506182 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:59.507463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:59.510749 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9064ad9-d7da-49ad-9517-e14fb79e8571"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:00:59.511931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:59.514463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:59.514921 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:59.515950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:59.516459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:59.518560 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:59.519253 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:59.520932 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:59.521373 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:59.688390 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:59.698722 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-47f799d0-a3ce-4194-93be-c0b31aa71550 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.196530 May 11 19:00:59.699332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 293/594] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:00:59 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:00:59.786179 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:00:59.787055 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:00:59.793173 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:59.793622 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:59.794390 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:00:59.794825 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:00:59.925124 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:59.937098 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:59.938921 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:00:59.940287 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-13c8e21f-8d82-4959-beeb-4baab43b7890 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.158966 May 11 19:00:59.940956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 294/595] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:00:59 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:00.723672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:00.724296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:00.731814 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:00.732640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:00.733894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:00.734410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:00.881800 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:00.890386 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5bff5b1d-a68d-492c-a528-ba3bbcc52399 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.176329 May 11 19:01:00.901183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 295/596] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:00 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:00.959541 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:00.960724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:00.970548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:00.971623 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:00.973125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:00.973733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:01.123430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:01.137905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:01.139405 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:01.140569 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ab1b5621-4a82-40e7-97a2-0925a385ac5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.185941 May 11 19:01:01.141642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 296/597] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:00 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:01.907467 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:01.908124 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:01.914213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:01.914699 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:01.915503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:01.915941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:02.070995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:02.079134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c62f0c90-512c-4720-9c53-f9a2e4eb7a4e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.175700 May 11 19:01:02.088532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 297/598] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:01 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:02.158631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:02.159245 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:02.165406 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:02.165999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:02.166906 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:02.167068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:02.318922 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:02.327502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:02.329101 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:02.330500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-42f3c68b-76d8-43f3-be1e-7a3140ed485a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.175797 May 11 19:01:02.331060 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 298/599] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:02 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:03.096248 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:03.096908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:03.103037 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:03.103525 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:03.104279 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:03.104715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:03.233098 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:03.241478 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-75424540-d190-48f9-a838-d08349397096 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.149173 May 11 19:01:03.242061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 299/600] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:03 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:03.349374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:03.349906 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:03.356094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:03.356549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:03.357326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:03.357872 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:03.495450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:03.504274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:03.505776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:03.506925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-390085a0-0595-4406-bd18-01d588eeb828 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.161697 May 11 19:01:03.507685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 300/601] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:03 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:04.259173 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:04.259863 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:04.267566 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:04.268122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:04.269078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:04.269553 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:04.413877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:04.422032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-89c915c3-1ea3-480f-a595-57f77bdaef05 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.166819 May 11 19:01:04.422983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 301/602] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:04 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:04.525370 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:04.526047 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:04.532337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:04.532793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:04.533609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:04.539227 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:04.683776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:04.692656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:04.694416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:04.695710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6f86ba59-477f-4e25-882b-1a0e5088407e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.174378 May 11 19:01:04.696272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 302/603] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:04 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:05.024213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:01:05.024459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Wed May 11 19:01:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:01:05.439038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:05.439813 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:05.447979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:05.448645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:05.449705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:05.450220 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:05.597863 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:05.605900 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-449d8e26-a511-4993-86fe-5a6fda66c1c8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.170717 May 11 19:01:05.612589 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 303/604] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:05 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:05.714913 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:05.715539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:05.722135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:05.722585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:05.723370 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:05.723808 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:05.867066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:05.875449 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:05.876955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:05.878101 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-026d18de-50c2-4c20-a666-f92233f87012 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.167153 May 11 19:01:05.878643 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 304/605] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:05 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:06.624756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:06.625489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:06.633396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:06.634078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:06.635031 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:06.635501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:06.782838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:06.791639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b843c7c4-f22c-463a-a449-6031a72bb8a8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.171129 May 11 19:01:06.792534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 305/606] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:06 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:06.896862 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:06.897509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:06.903585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:06.904103 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:06.904939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:06.905618 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:07.052553 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:07.061279 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:07.062773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:07.063993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-79483b58-9978-4079-98dc-37581a7850b7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.171109 May 11 19:01:07.064554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 306/607] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:06 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:07.809584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:07.810299 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:07.817934 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:07.818319 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:07.819362 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:07.820065 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:07.962547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:07.970981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b01f758e-83c1-40a0-8e69-c224d422feeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.165586 May 11 19:01:07.971590 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 307/608] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:07 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:08.083193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:08.083734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:08.089677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:08.090121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:08.090875 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:08.091317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:08.236960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:08.248546 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:08.250759 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:08.252387 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f4a793cb-08e9-4975-9a8f-cae90e64bbfe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.173073 May 11 19:01:08.253575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 308/609] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:08 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:08.989784 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:08.990550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:08.997337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:08.997914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:08.998794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:08.999270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:09.162991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:09.184575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e730a300-9fac-4a1d-a786-43097234fc36 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.200336 May 11 19:01:09.188470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 309/610] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:08 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:09.270930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:09.271985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:09.278694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:09.279238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:09.280065 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:09.280514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:09.465524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:09.489246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:09.491734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:09.501652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7362a723-03f4-465b-bba7-cd41a3f2bb8d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.226575 May 11 19:01:09.502559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 310/611] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:09 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:10.205262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:10.205984 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:10.212582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:10.212973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:10.213736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:10.214169 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:10.337098 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:10.345694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6c8e23b4-7489-4c1b-b0c8-d143cf247383 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1722 microversion: 2.1 time: 0.144822 May 11 19:01:10.346251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 311/612] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:10 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:10.525396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:10.525919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:10.532266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:10.532720 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:10.533476 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:10.533909 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:10.665321 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:10.675486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:10.677040 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:10.678385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6974a263-a8cc-46b0-b709-02096fa41264 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.157277 May 11 19:01:10.678998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 312/613] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:10 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:11.362163 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:11.362820 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:11.369085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.369637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.370464 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.370970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.510007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:11.523946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e5bde63a-6fd6-49f7-9340-85d888cad077 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1699 microversion: 2.1 time: 0.164168 May 11 19:01:11.526488 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 313/614] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:11 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:11.545261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ff5bdd45-df28-451a-ada5-082cb04969b3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:11.553158 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd45-df28-451a-ada5-082cb04969b3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.554015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd45-df28-451a-ada5-082cb04969b3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.626941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ff5bdd45-df28-451a-ada5-082cb04969b3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Going to try to start instance {{(pid=117096) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 19:01:11.652881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-38943037-28ea-481e-9681-c694bbd29e66 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.147510 May 11 19:01:11.654058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 302/615] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:00:59 2022] POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments => generated 194 bytes in 12149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:01:11.688845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ff5bdd45-df28-451a-ada5-082cb04969b3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action" status: 202 len: 0 microversion: 2.1 time: 0.149225 May 11 19:01:11.692672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 314/616] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:01:11 2022] POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:01:11.700311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:11.700558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:11.701016 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:11.701400 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:11.708244 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.708500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.708883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.709132 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.710068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.710357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:11.710656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.711120 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:11.858128 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:11.867640 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:11.869178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:11.870464 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-77878624-0e61-4326-93d0-979549535e31 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.176692 May 11 19:01:11.871632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 303/617] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:11 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:11.889395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:11.898241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-53215050-d2df-4c54-adf1-6be549d5345e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.203915 May 11 19:01:11.898941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 315/618] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:11 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:12.889706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:12.890321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:12.897601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:12.898061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:12.898835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:12.899273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:12.916030 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:12.916746 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:12.924055 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:12.924788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:12.925669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:12.926337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:13.047186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:13.056558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:13.058331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:13.059529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cc4ee9a7-5d9b-4bc4-bcbf-a7b1aadae10d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.173744 May 11 19:01:13.060097 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 304/619] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:12 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:13.092276 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:13.100178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-72447eea-a952-4566-8516-12218d9fb2a2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.188237 May 11 19:01:13.100770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 316/620] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:12 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:14.078033 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:14.078635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:14.085022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:14.085467 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:14.086221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:14.086655 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:14.118723 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:14.119394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:14.126365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:14.126842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:14.127650 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:14.128097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:14.222632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:14.231989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:14.233497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:14.235228 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-df0a9e87-a893-4843-891e-406123c69b0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.160624 May 11 19:01:14.235833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 305/621] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:14 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:14.262130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:14.270367 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-df5bb54a-6040-4da2-8301-0a05f488e587 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.155850 May 11 19:01:14.270946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 317/622] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:14 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:15.256264 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:15.256929 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:15.265002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:15.265453 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:15.266791 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:15.267225 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:15.287021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:15.287648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:15.294340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:15.294804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:15.295597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:15.296033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:15.401500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:15.410352 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:15.412085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:15.413484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-28c24161-c597-4b1c-bc1c-f7963b43537f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.163007 May 11 19:01:15.413927 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 306/623] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:15 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:15.430761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:15.440108 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-aa6b48fd-c60d-474c-b2fd-1f93bc265c19 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.156765 May 11 19:01:15.440908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 318/624] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:15 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:16.431620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:16.432232 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:16.438575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:16.439024 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:16.439813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:16.440254 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:16.458095 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:16.459347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:16.464976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:16.465422 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:16.466177 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:16.466605 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:16.569859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:16.578022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:16.580384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:16.581564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7b539418-7a4b-494b-b737-9d1ee45193ab tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.153772 May 11 19:01:16.582118 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 307/625] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:16 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:16.599042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:16.606839 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c896e509-2864-4656-8daa-8b465df76c8e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.152756 May 11 19:01:16.607415 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 319/626] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:16 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:17.600682 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:17.601311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:17.607618 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:17.608151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:17.609007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:17.610021 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:17.624017 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:17.626182 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:17.632818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:17.633535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:17.634533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:17.635213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:17.771765 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:17.773136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:17.780777 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:17.781258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3804dc2d-340d-4740-bc63-7103573ab62f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.160977 May 11 19:01:17.781838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 320/627] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:17 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:01:17.782315 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:17.783501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a654c6ef-3bf9-4528-af61-c8b3a8d02a45 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.187659 May 11 19:01:17.784054 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 308/628] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:17 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:18.797951 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:18.798557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:18.800538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:18.801131 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:18.804909 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:18.805365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:18.806130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:18.806564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:18.807344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:18.807799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:18.808561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:18.808996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:18.937211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:18.938568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:18.945754 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f8e940c4-e123-402e-a1f0-0abc8243a778 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.151709 May 11 19:01:18.946310 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 321/629] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:18 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:18.947219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:18.948808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:18.950047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-75649d89-f528-4192-bd88-40c88e70c468 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.153348 May 11 19:01:18.950676 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 309/630] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:18 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:19.963205 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:19.963897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:19.968411 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:19.969671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:19.971070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:19.971563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:19.972344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:19.972814 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:19.975938 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:19.976392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:19.977353 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:19.977796 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:20.099436 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:20.108063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f1d5d393-87ca-437f-8850-8373741af2d8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.148650 May 11 19:01:20.114078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 322/631] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:19 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:20.114200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:20.120515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:20.122008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:20.123159 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4e2df3af-b5d7-4343-a175-46b00c0217ce tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.158620 May 11 19:01:20.123744 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 310/632] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:19 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:21.124037 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:21.124639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:21.131445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:21.131892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:21.132649 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:21.133083 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:21.141457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:21.142068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:21.148351 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:21.148801 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:21.149566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:21.150003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:21.262989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:21.272214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-63e6147c-3e60-4b41-9e6d-3c1187d0d433 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.151961 May 11 19:01:21.272781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 323/633] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:21 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:21.286926 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:21.295253 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:21.296844 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:21.298015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e035d191-0351-487e-9e32-8173465f7c77 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.160978 May 11 19:01:21.298576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 311/634] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:21 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:22.288377 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:22.288973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:22.295219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:22.295706 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:22.296454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:22.296916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:22.315999 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:22.316672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:22.323211 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:22.323705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:22.324474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:22.324921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:22.426029 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:22.434017 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6dc5dfb4-32cb-4512-b389-51b9c367d225 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.149446 May 11 19:01:22.434579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 324/635] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:22 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:22.450966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:22.459813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:22.461267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:22.462433 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-237bd6e6-1a04-4f1c-818a-2a80f050f684 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.150403 May 11 19:01:22.463850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 312/636] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:22 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:23.450725 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:23.451999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:23.458848 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:23.459225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:23.460012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:23.460442 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:23.483098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:23.483837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:23.490179 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:23.490719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:23.491511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:23.491949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:23.587395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:23.595322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0ef49ea1-c8ad-4e4d-86c5-ea4c31b62947 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.148248 May 11 19:01:23.595910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 325/637] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:23 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:23.633247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:23.641481 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:23.643038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:23.644226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ab82988f-801c-4bc3-a80e-e380062c7a2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.165026 May 11 19:01:23.644782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 313/638] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:23 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:24.612582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:24.613258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:24.619524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:24.619971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:24.620773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:24.621204 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:24.662171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:24.662784 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:24.669158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:24.669611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:24.670384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:24.670823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:24.751568 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:24.759510 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-421f59a9-62a7-4d2c-85c8-d31a639f77e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.151284 May 11 19:01:24.760078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 326/639] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:24 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:24.799015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:24.807054 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:24.808578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:24.809760 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-15226043-ef15-45b0-8924-61f19c75c74a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.151446 May 11 19:01:24.810260 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 314/640] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:24 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:25.776124 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:25.776842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:25.782777 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:25.783232 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:25.784036 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:25.784471 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:25.830719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:25.831326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:25.837524 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:25.837966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:25.838732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:25.839159 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:25.922137 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:25.930129 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-674f23a3-5291-4170-a5e2-bdfc798edc2e tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1708 microversion: 2.1 time: 0.157945 May 11 19:01:25.930695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 327/641] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:25 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:25.974727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:25.982949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:25.986087 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:25.987251 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6c61c48d-7a06-4fcb-8042-ef19f28a1810 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.161209 May 11 19:01:25.987848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 315/642] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:25 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:26.948437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:26.949075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:26.956447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:26.956899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:26.957894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:26.958389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:27.005739 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:27.014881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:27.026021 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:27.026481 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:27.027277 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:27.027819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:27.098530 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:27.106575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9dc6ac68-59b5-49a3-a27a-39e4128e27e6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1712 microversion: 2.1 time: 0.162128 May 11 19:01:27.107563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 328/643] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:26 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1712 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:27.161986 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:27.170134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:27.171656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:27.172812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-48fce0b4-4c59-4b36-a672-e94f5aebf15c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.171020 May 11 19:01:27.173373 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 316/644] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:27 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:28.191193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:28.192418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:28.199040 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:28.199531 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:28.200306 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:28.200742 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:28.362122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:28.370426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:28.371973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:28.373130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f1c1df42-a8b0-4c47-8e5b-4452c909a824 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.185933 May 11 19:01:28.373705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 329/645] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:28 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:29.391252 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:29.391794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:29.398157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:29.398602 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:29.399390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:29.399827 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:29.527874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:29.536603 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:29.538098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:29.539248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-41f2a7a9-4eb8-4e0e-a8fd-dd506fa67398 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.151964 May 11 19:01:29.539842 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 317/646] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:29 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:30.558454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:30.559064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:30.565482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:30.565937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:30.566698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:30.567133 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:30.697307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:30.705975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:30.707497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:30.708640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5f3200f6-4265-48c3-8382-b439f4968063 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.154391 May 11 19:01:30.709191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 330/647] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:30 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:31.726542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:31.727162 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:31.733518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:31.733964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:31.734728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:31.735741 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:31.874186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:31.882543 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:31.883991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:31.885145 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e73ffd32-dfed-4923-9a36-180c85a36740 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.162565 May 11 19:01:31.885736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 318/648] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:31 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:32.899029 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:32.899979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:32.904612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:32.908566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:32.908938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:32.909404 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:32.910185 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:32.910623 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:32.913243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:32.913797 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:32.914758 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:32.915494 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:33.040441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:33.048460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-97b5dae0-6280-40f1-b267-18105e624b9f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1593 microversion: 2.1 time: 0.154323 May 11 19:01:33.048611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:33.049034 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 331/649] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:32 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:33.060516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:33.062011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:33.063714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0594ff98-7a9a-42ab-9583-251b7cb24faa tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.163493 May 11 19:01:33.064269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 319/650] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:32 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:34.082115 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:34.082724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:34.089035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:34.089485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:34.090246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:34.090680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:34.236050 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:34.246482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:34.248477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:34.249498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-173853ec-51d8-44c0-be8b-0a5060cdbc4a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.171918 May 11 19:01:34.250200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 332/651] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:34 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:34.300216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-2cbe8970-54d2-4fdc-8c40-6ee84560918c req-1e0c90b0-95f5-46b7-8584-fe0c57c01374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "name": "network-vif-plugged", "status": "completed", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:34.309760 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-2cbe8970-54d2-4fdc-8c40-6ee84560918c req-1e0c90b0-95f5-46b7-8584-fe0c57c01374 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:34.310439 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-2cbe8970-54d2-4fdc-8c40-6ee84560918c req-1e0c90b0-95f5-46b7-8584-fe0c57c01374 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:34.325069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-2cbe8970-54d2-4fdc-8c40-6ee84560918c req-1e0c90b0-95f5-46b7-8584-fe0c57c01374 service nova] Creating event network-vif-plugged:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 19:01:34.331705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-2cbe8970-54d2-4fdc-8c40-6ee84560918c req-1e0c90b0-95f5-46b7-8584-fe0c57c01374 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034712 May 11 19:01:34.332316 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 320/652] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:01:35.062659 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-8747eaa4-1cf5-463b-950d-13ff1fe4f327 req-1c3930ec-74b7-4f2d-8619-463c6280e930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:35.075823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-8747eaa4-1cf5-463b-950d-13ff1fe4f327 req-1c3930ec-74b7-4f2d-8619-463c6280e930 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:35.076278 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-8747eaa4-1cf5-463b-950d-13ff1fe4f327 req-1c3930ec-74b7-4f2d-8619-463c6280e930 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:35.091959 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-8747eaa4-1cf5-463b-950d-13ff1fe4f327 req-1c3930ec-74b7-4f2d-8619-463c6280e930 service nova] Creating event network-changed:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:01:35.097581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-8747eaa4-1cf5-463b-950d-13ff1fe4f327 req-1c3930ec-74b7-4f2d-8619-463c6280e930 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039134 May 11 19:01:35.098546 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 333/653] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:01:35.273853 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:35.274562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:35.283098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:35.285521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:35.286341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:35.286785 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:35.477532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:35.486718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:35.488350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:35.489708 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e8c9742a-8f97-4c61-ac90-f99dfca9e954 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.225646 May 11 19:01:35.490434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 321/654] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:35 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:36.135001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1633907755"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:36.135672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:36.141875 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:36.142329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:36.143125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:36.143593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:36.278849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.network.security_group_api [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Adding security group e82cfbde-02f9-4feb-a552-e798d6aef456 to port 3f7b9c68-8d57-4c3e-aa14-d14169f7215f May 11 19:01:36.508935 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:36.510105 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:36.517892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:36.518342 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:36.519551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:36.519989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:36.795552 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:36.807069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:36.808610 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:36.809838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-683ba382-870e-48c3-a428-8b8d2e89276a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.306167 May 11 19:01:36.810748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 322/655] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:36 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:01:37.030931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-08f60ab3-2b36-40d7-89a9-6afab4c7c5e9 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/action" status: 202 len: 0 microversion: 2.1 time: 0.900529 May 11 19:01:37.035405 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 334/656] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:01:36 2022] POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/action => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:01:37.040210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:37.040832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:37.046007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-34cfe42d-094a-4095-a814-a54184a400ee req-47e88a5a-d8bb-4439-afc4-1db40e5ec090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:37.053211 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:37.055774 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:37.056590 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:37.064579 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:37.068185 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-34cfe42d-094a-4095-a814-a54184a400ee req-47e88a5a-d8bb-4439-afc4-1db40e5ec090 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:37.069516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-34cfe42d-094a-4095-a814-a54184a400ee req-47e88a5a-d8bb-4439-afc4-1db40e5ec090 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:37.090116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-34cfe42d-094a-4095-a814-a54184a400ee req-47e88a5a-d8bb-4439-afc4-1db40e5ec090 service nova] Creating event network-changed:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:01:37.097309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-34cfe42d-094a-4095-a814-a54184a400ee req-47e88a5a-d8bb-4439-afc4-1db40e5ec090 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054744 May 11 19:01:37.099075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 335/657] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:01:37.296238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:37.308298 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7485266f-83bb-428e-b405-f5600414ecaf tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1640 microversion: 2.1 time: 0.271674 May 11 19:01:37.309228 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 323/658] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:37 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1640 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:37.833267 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:37.834202 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:37.840494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:37.841210 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:37.842141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:37.842803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:38.058859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:38.067783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:38.069726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:38.070803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9b9464a7-bfc0-4f86-ba07-b386f7c3f433 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1807 microversion: 2.20 time: 0.245282 May 11 19:01:38.075350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 336/659] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:37 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:39.089958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:39.090469 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:39.097416 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:39.097858 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:39.098615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:39.099048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:39.230514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:39.240026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:39.241625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:39.242815 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4af1562d-1bfc-45c3-8b04-18f2008ba57f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1794 microversion: 2.20 time: 0.156863 May 11 19:01:39.243405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 324/660] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:01:39 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:01:51.821354 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa2a133a-be48-43ba-9780-394ec9e012e2"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:51.822416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:51.829204 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:51.829652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:51.830420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:51.830858 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:52.100510 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6e2a25c2-ac90-4bb8-8927-8be2ec049e6b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283270 May 11 19:01:52.101188 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 337/661] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:01:51 2022] POST /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:01:57.525501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:01:57.526497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:57.533601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:57.534046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:57.534805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:57.535238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:57.605792 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d61f725b-7a4f-4019-acb6-5401dabfdc6c tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/action" status: 202 len: 0 microversion: 2.1 time: 0.084144 May 11 19:01:57.606410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 325/662] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:01:57 2022] POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:01:57.615619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:57.616398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:57.622666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:57.623116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:57.623916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:57.624356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:57.778705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:57.786783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1ba8b46f-914f-455f-804d-d98f1efdcf21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1750 microversion: 2.1 time: 0.175856 May 11 19:01:57.787478 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 338/663] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:57 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:58.805326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:58.805960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:58.812908 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:58.813355 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:58.814109 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:58.814538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:58.953885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:01:58.961592 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-99bf642f-5336-4459-8c4a-0a10e3cc211e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1750 microversion: 2.1 time: 0.160567 May 11 19:01:58.962155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 326/664] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:58 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:01:59.978525 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:01:59.979127 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:01:59.986226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:59.986676 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:01:59.987482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:01:59.987927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.128456 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:00.136405 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b14d9239-a213-4742-9d7d-6e4e521cc46a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.161875 May 11 19:02:00.137007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 339/665] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:01:59 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:00.661457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:00.662005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:00.668246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.668709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.669501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.669937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.693669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c35f110c-3ebf-4041-bd70-6969f28ac5ca tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/ips" status: 200 len: 148 microversion: 2.1 time: 0.036025 May 11 19:02:00.694815 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 327/666] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 19:02:00 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:00.704940 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b370903b-556e-4553-aec8-1a5fe5e59e25"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:00.706052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:00.712318 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.712770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.713534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.713962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.776733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:00.777753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:00.787554 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.788043 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.788834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.789271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.792502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Invalid volume: volume b370903b-556e-4553-aec8-1a5fe5e59e25 is already attached to instances: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: POST /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/os-volume_attachments HTTP/1.1 May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 74 May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:02:00.794447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {"volumeAttachment": {"volumeId": "b370903b-556e-4553-aec8-1a5fe5e59e25"}} May 11 19:02:00.796002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Invalid volume: volume b370903b-556e-4553-aec8-1a5fe5e59e25 is already attached to instances: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'server_id': '566e7940-0d8b-421c-87de-d7fc5c7db98a', 'body': {'volumeAttachment': {'volumeId': 'b370903b-556e-4553-aec8-1a5fe5e59e25'}}} May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b370903b-556e-4553-aec8-1a5fe5e59e25 is already attached to instances: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:00.797490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b370903b-556e-4553-aec8-1a5fe5e59e25 is already attached to instances: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:00.798681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b370903b-556e-4553-aec8-1a5fe5e59e25 is already attached to instances: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 400 to user: Invalid volume: volume b370903b-556e-4553-aec8-1a5fe5e59e25 is already attached to instances: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-78a8faf2-d3a8-4540-a585-9d7a178e834b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095001 May 11 19:02:00.800097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 340/667] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:02:00 2022] POST /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 19:02:00.805044 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:00.805541 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:00.811247 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.811865 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.812638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.813077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.813190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'flavor' on Instance uuid 7e73aaf5-ec3f-4e29-8e67-597130c372fb {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:02:00.838093 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:02:00.916632 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3804788e-63e4-4e34-8c80-4a87490f10d9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 204 len: 0 microversion: 2.1 time: 0.114655 May 11 19:02:00.917024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 341/668] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:02:00 2022] DELETE /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:02:00.928500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:00.928724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:00.937062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.937906 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.938968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.939447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.946074 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-dca40b12-e49b-4c89-9f8c-cc8b666e91fe tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/action" status: 200 len: 32 microversion: 2.1 time: 0.173302 May 11 19:02:00.947030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 328/669] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:02:00 2022] POST /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 19:02:00.959903 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:00.960601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:00.967206 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.967685 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:00.969216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:00.969724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:01.091748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:01.099666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f15ec247-bca0-4af5-81cf-ea9c919c03a1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1680 microversion: 2.1 time: 0.177845 May 11 19:02:01.100240 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 342/670] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:00 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:01.111015 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:01.118877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-40369cc1-06b6-4909-8631-240e5be2e196 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.163274 May 11 19:02:01.119468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 329/671] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:00 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:01.155947 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:01.157186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:01.163057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:01.163602 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:01.165071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:01.165071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:01.304887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:01.312646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-19cce594-8088-45dc-b5cf-f27f3defe210 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.160569 May 11 19:02:01.313215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 343/672] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:01 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:02.117004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:02.117608 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:02.123859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:02.124302 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:02.125081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:02.125511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:02.135883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:02.136488 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:02.143213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:02.143695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:02.144461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:02.144903 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:02.258864 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:02.266838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2e8bdc99-e76d-4ebd-9f12-080f4e75c506 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1680 microversion: 2.1 time: 0.153558 May 11 19:02:02.267591 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 330/673] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:02 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:02.280400 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:02.288128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8c1606ec-3ceb-410d-a1a0-fdff034d1f52 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.156039 May 11 19:02:02.288692 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 344/674] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:02 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:02.330673 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:02.331275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:02.338154 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:02.338741 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:02.339567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:02.340001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:02.481749 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:02.489526 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-99acaac6-cbd7-4776-9986-2fba1f89d353 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.163864 May 11 19:02:02.490101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 331/675] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:02 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:03.285029 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:03.285642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:03.291968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:03.292424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:03.293200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:03.293640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:03.305617 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:03.306219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:03.313617 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:03.314517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:03.315288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:03.315745 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:03.432231 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:03.439796 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2daf96f3-d97d-4606-b4be-634f408194d0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1680 microversion: 2.1 time: 0.159374 May 11 19:02:03.440371 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 345/676] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:03 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:03.450276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:03.458899 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-53a8a6ad-dff2-490f-8383-8d7def1231b6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.157577 May 11 19:02:03.459688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 332/677] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:03 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:03.506001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:03.506944 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:03.512930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:03.513388 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:03.514163 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:03.514603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:03.766544 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:03.776179 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-73cdb6ea-dd79-412d-908a-77d738ccbacc tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.274101 May 11 19:02:03.785528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 346/678] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:03 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:04.451953 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-036a1f2b-b732-4350-a370-e50ca2c3bee1 req-69e3de57-8d9e-4f15-8065-2cc864ba8455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566e7940-0d8b-421c-87de-d7fc5c7db98a", "name": "network-vif-deleted", "tag": "e43aea4f-9550-41a9-8237-a44c594c43ea"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:04.458320 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:04.459893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:04.460029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-036a1f2b-b732-4350-a370-e50ca2c3bee1 req-69e3de57-8d9e-4f15-8065-2cc864ba8455 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.460474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-036a1f2b-b732-4350-a370-e50ca2c3bee1 req-69e3de57-8d9e-4f15-8065-2cc864ba8455 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.471290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.471890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.473209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.473758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.474710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-036a1f2b-b732-4350-a370-e50ca2c3bee1 req-69e3de57-8d9e-4f15-8065-2cc864ba8455 service nova] Creating event network-vif-deleted:e43aea4f-9550-41a9-8237-a44c594c43ea for instance 566e7940-0d8b-421c-87de-d7fc5c7db98a on hv-cinder-75510 May 11 19:02:04.481022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-036a1f2b-b732-4350-a370-e50ca2c3bee1 req-69e3de57-8d9e-4f15-8065-2cc864ba8455 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 May 11 19:02:04.481660 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 333/679] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:04.498370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:04.500534 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:04.509102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.509779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.510882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.511509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.563735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:04.573986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-61d4b111-b52a-4e77-8ab9-7ff5ecc509e5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 200 len: 1612 microversion: 2.1 time: 0.120146 May 11 19:02:04.583703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 347/680] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:04 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 1612 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:04.685593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:04.698035 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8ad7dd47-5435-4afe-8737-a62ac897b8d3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.210066 May 11 19:02:04.698777 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 334/681] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:04 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:04.793548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:04.794365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:04.801148 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.801603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.802374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:04.802810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:04.943892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:04.952113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0518db7a-a930-4481-b554-064585c3b0e0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.162630 May 11 19:02:04.952928 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 348/682] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:04 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:05.590689 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:05.591388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:05.598587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:05.598955 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:05.599764 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:05.600208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:05.614614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a HTTP/1.1 May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:02:05.616328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:02:05.617622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '566e7940-0d8b-421c-87de-d7fc5c7db98a'} May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:02:05.618350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:02:05.619516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:05.621987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:02:05.622851 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d3f79969-af9a-4ecc-99d6-fcffc2ac27d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 404 len: 111 microversion: 2.1 time: 0.036172 May 11 19:02:05.623450 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 335/683] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:05 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 19:02:05.632352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9fd4154c-6876-4f8d-ae65-9d1a67958f70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '.version_select at 0x7fa79084b160>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:05.654654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9fd4154c-6876-4f8d-ae65-9d1a67958f70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179025171" status: 202 len: 0 microversion: 2.1 time: 0.025966 May 11 19:02:05.655250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 349/684] 10.222.0.93 () {58 vars in 1217 bytes} [Wed May 11 19:02:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179025171 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:02:05.716061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:05.716685 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:05.722895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:05.723477 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:05.724350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:05.724849 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:05.889376 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:05.899685 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8393c823-c8d5-45ed-8fb7-47f4fa43febf tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.187523 May 11 19:02:05.900674 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 336/685] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:05 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:05.970245 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:05.970763 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:05.977026 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:05.977469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:05.978260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:05.978692 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:06.234082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:06.242905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-75f67579-6611-4853-8ff3-068ffc7bca81 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.277138 May 11 19:02:06.243952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 350/686] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:05 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:06.468603 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:06.469685 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:06.475916 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:06.476368 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:06.477159 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:06.477596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:06.603427 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lazy-loading 'services' on Instance uuid 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:02:06.716650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b1b9163d-62f6-46af-8c16-721a9db0dec7 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments/b370903b-556e-4553-aec8-1a5fe5e59e25" status: 202 len: 0 microversion: 2.1 time: 0.251817 May 11 19:02:06.717239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 337/687] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:02:06 2022] DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments/b370903b-556e-4553-aec8-1a5fe5e59e25 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:02:06.726923 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:06.727911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:06.734313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:06.735108 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:06.735912 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:06.736349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:06.769501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d2bd1393-2043-46a0-96a3-144e68e430c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047540 May 11 19:02:06.770420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 351/688] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:02:06 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:02:06.918035 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:06.918469 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:06.925123 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:06.925577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:06.926341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:06.926780 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:07.057320 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:07.065701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-97855b5d-9a64-40c3-a0a5-bb19fddac3f2 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.152179 May 11 19:02:07.066311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 338/689] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:06 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:07.260114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:07.260727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:07.266673 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:07.267130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:07.267925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:07.268362 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:07.410979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:07.419645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5f084775-4088-444f-b6f9-c17e14e38a5b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.163192 May 11 19:02:07.420236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 352/690] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:07 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:07.780545 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:07.782036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:07.788382 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:07.788833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:07.789599 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:07.790042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:07.818700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9c9bda6a-4c27-48c1-8a11-d109d9dbcc97 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042095 May 11 19:02:07.819541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 339/691] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:02:07 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:08.084380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:08.085032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:08.092230 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.092722 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.093528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.094526 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.224607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:08.232498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b8ebdfb0-3ec4-4e43-9893-ba31393e4d41 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.152123 May 11 19:02:08.233061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 353/692] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:08 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:08.436993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:08.438110 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:08.444310 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.444756 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.445516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.445946 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.586589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:08.594744 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-de57cd1c-4477-4391-a47a-efc4aa88ab85 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.161610 May 11 19:02:08.595601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 340/693] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:08 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:08.830782 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:08.831641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:08.837544 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.837997 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.838758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.839192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.866740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f498efac-6155-4c64-998f-60549c1649f8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040078 May 11 19:02:08.867289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 354/694] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:02:08 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:02:08.922332 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:08.922808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:08.929293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.929746 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.930509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:08.930944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:08.959368 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:02:09.033090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-75f1a673-9b91-4189-aed2-1f01d6f75492 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 204 len: 0 microversion: 2.1 time: 0.114850 May 11 19:02:09.033780 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 341/695] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:02:08 2022] DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:02:09.042490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:09.043127 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:09.049771 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:09.050224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:09.051031 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:09.051541 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:09.176693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:09.184086 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-dfc930ae-28d9-4aff-8d76-8604058cdff2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1682 microversion: 2.1 time: 0.145354 May 11 19:02:09.184656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 355/696] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:09 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:09.250063 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:09.250751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:09.256680 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:09.257125 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:09.257874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:09.258301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:09.386367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:09.395488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e98a6d67-c061-4137-9fc1-fdabccff98be tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.149824 May 11 19:02:09.396050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 342/697] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:09 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:09.611896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:09.612506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:09.618485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:09.618933 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:09.619724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:09.620160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:09.760950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:09.769568 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e383e314-d07e-4c36-83e8-d2a28f6a5a64 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.161925 May 11 19:02:09.770136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 356/698] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:09 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:10.200702 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:10.201308 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:10.207867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:10.209605 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:10.209605 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:10.209605 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:10.338158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:10.347906 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-49f8a066-09bc-41f3-8232-1f3053a70eb6 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1682 microversion: 2.1 time: 0.151023 May 11 19:02:10.348506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 343/699] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:10 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:10.412914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:10.413512 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:10.419755 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:10.420197 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:10.420952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:10.421379 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:10.544639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:10.552918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d9fb4c11-dfb3-4b1a-8e65-82e4b74fceaa tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.143851 May 11 19:02:10.553489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 357/700] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:10 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:10.786872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:10.787459 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:10.793379 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:10.793827 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:10.794586 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:10.795020 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:10.930703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:10.938388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bdc64b51-c408-4e44-95b9-0ecd86c7181a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.155391 May 11 19:02:10.938950 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 344/701] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:10 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:11.365521 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:11.366117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:11.372259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:11.372711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:11.373513 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:11.373977 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:11.572766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:11.573407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:11.580562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:11.581009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:11.581776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:11.582208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:11.590740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:11.599119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5e612b51-1aa4-49d7-8150-2fed8111a3f5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1682 microversion: 2.1 time: 0.237405 May 11 19:02:11.599829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 358/702] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:11 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:11.720845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:11.729280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a76d15c4-44af-4de2-aaa3-2ea5bd130d9d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.160520 May 11 19:02:11.730032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 345/703] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:11 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:11.956062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:11.956663 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:11.962532 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:11.962971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:11.963746 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:11.964180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:12.225007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:12.232834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d645d891-74dc-4088-b001-d6a1407decda tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.281169 May 11 19:02:12.233396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 359/704] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:11 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:12.617249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:12.617967 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:12.624634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:12.625778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:12.626581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:12.627953 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:12.634167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-4fd7d6fd-ea2d-4248-9b1a-a189c2dc218a req-24b91e18-fc00-46a0-9a5b-ec25dba86c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448cb11d-d94b-46e6-bf14-e2ee5b9e93a6", "name": "network-vif-deleted", "tag": "e5af5d5d-0808-45ef-abf7-442fa1ffa345"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:12.643376 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4fd7d6fd-ea2d-4248-9b1a-a189c2dc218a req-24b91e18-fc00-46a0-9a5b-ec25dba86c8f service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:12.644061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4fd7d6fd-ea2d-4248-9b1a-a189c2dc218a req-24b91e18-fc00-46a0-9a5b-ec25dba86c8f service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:12.655931 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-4fd7d6fd-ea2d-4248-9b1a-a189c2dc218a req-24b91e18-fc00-46a0-9a5b-ec25dba86c8f service nova] Creating event network-vif-deleted:e5af5d5d-0808-45ef-abf7-442fa1ffa345 for instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 on hv-cinder-75510 May 11 19:02:12.661767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-4fd7d6fd-ea2d-4248-9b1a-a189c2dc218a req-24b91e18-fc00-46a0-9a5b-ec25dba86c8f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031357 May 11 19:02:12.662987 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 360/705] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:12.746311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:12.753832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:12.755038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:12.762830 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:12.763384 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:12.764160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:12.764603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:12.767350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9f67100f-e712-4f25-a4c1-195a38091e70 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 200 len: 1614 microversion: 2.1 time: 0.151945 May 11 19:02:12.768048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 346/706] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:12 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 1614 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:12.926009 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:12.934844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f4f9e461-fc69-442b-b911-966e018ec008 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.191296 May 11 19:02:12.935372 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 361/707] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:12 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:13.250143 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:13.251260 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:13.259942 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:13.260439 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:13.261821 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:13.262604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:13.450020 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:13.458862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5c8866c6-df28-4c82-8a58-77723a62ee1f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.212644 May 11 19:02:13.459380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 347/708] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:13 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:13.784627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:13.785284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:13.792314 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:13.792758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:13.793515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:13.793942 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:13.807842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 HTTP/1.1 May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:02:13.809463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:02:13.811990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '448cb11d-d94b-46e6-bf14-e2ee5b9e93a6'} May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:02:13.813434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:02:13.815134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:13.816636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:02:13.816636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ea59f2c5-25a3-4a2f-868e-28556324be5a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 404 len: 111 microversion: 2.1 time: 0.030165 May 11 19:02:13.816636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 362/709] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:13 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:02:13.821228 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1b727743-63a9-4efb-8202-35bbc00a5993 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '.version_select at 0x7fa787505f70>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:13.840013 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1b727743-63a9-4efb-8202-35bbc00a5993 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983102623" status: 202 len: 0 microversion: 2.1 time: 0.022658 May 11 19:02:13.840588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 348/710] 10.222.0.93 () {58 vars in 1220 bytes} [Wed May 11 19:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983102623 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:02:13.951938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:13.952554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:13.959581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:13.960063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:13.960987 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:13.961772 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:14.216872 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:14.225526 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-92bdbee2-19c9-4b7f-bfc1-e0ad6b6d93ae tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.277354 May 11 19:02:14.227225 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 363/711] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:13 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:14.476117 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:14.476850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:14.482760 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:14.483212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:14.484029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:14.484462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:14.557203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2e199771-be9b-4781-9ac3-1a41201ab1a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: .version_select at 0x7fa7876605e0>, body: {"keypair": {"name": "tempest-keypair-1355410743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9YNFZcRZIQ8RKK0PEMD1pY3aahBkJDBICQDlGIxEnA7Ykev3xGzRkAeL4RQOF2LHuEkENbmqFHbxJazfBP0MzXi6f8WpJDLLyGqCLjiQznKcrHrMSW+Ec99Nk1UE8JWg=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:14.572787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-2e199771-be9b-4781-9ac3-1a41201ab1a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:02:14.576714 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-2e199771-be9b-4781-9ac3-1a41201ab1a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:02:14.602339 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2e199771-be9b-4781-9ac3-1a41201ab1a0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049513 May 11 19:02:14.603191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 364/712] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 19:02:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:02:14.632386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:14.640585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3669363c-2a27-4c9f-b8f2-18c536f7388f tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.168322 May 11 19:02:14.641906 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 349/713] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:14 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:15.243945 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:15.244688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:15.251371 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:15.251829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:15.252613 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:15.253052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:15.384855 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:15.393486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0fb4ef5b-47da-4b52-8a60-ada9b260f95b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.153949 May 11 19:02:15.394070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 365/714] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:15 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:15.658406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:15.659022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:15.665550 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:15.666117 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:15.667052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:15.667628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:15.884810 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:15.893144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cfa95865-e5fa-418d-9cbc-7f5961933a7a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1755 microversion: 2.1 time: 0.238882 May 11 19:02:15.893724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 350/715] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:15 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:16.192543 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1918669528", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834a0-4dee-47c7-b460-ae66831e3d5b"}], "security_groups": [{"name": "tempest-securitygroup--1589355073"}], "key_name": "tempest-keypair-1355410743", "user_data": "}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:16.291313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] validate_networks() for [('6b6834a0-4dee-47c7-b460-ae66831e3d5b', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:02:16.409888 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:16.410521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:16.416498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:16.416954 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:16.417780 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:16.418212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:16.549769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:16.558081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f233028d-b96a-4c6e-847b-cc1dd602c9b4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.151928 May 11 19:02:16.558670 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 351/716] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:16 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:16.663493 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:02:16.663920 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:02:16.664395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:02:16.664807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:02:16.665219 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:02:16.674354 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:16.674804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:16.675656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:16.676097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:16.692633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:02:16.696880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:02:16.707624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:02:16.709843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:02:16.755771 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4e265a96-fe70-404e-b650-630bcb57dab0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567945 May 11 19:02:16.756754 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 366/717] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:02:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:02:16.767622 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7960ea88-e580-4d2b-bb63-53b39234c9c4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:16.768240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7960ea88-e580-4d2b-bb63-53b39234c9c4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:16.837719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7960ea88-e580-4d2b-bb63-53b39234c9c4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:16.844883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7960ea88-e580-4d2b-bb63-53b39234c9c4 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1242 microversion: 2.1 time: 0.081711 May 11 19:02:16.845450 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 352/718] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:16 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:16.910598 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:16.911429 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:16.917348 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:16.917799 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:16.918563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:16.919000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:17.078614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:17.086615 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1b14040e-241e-47bf-918b-e66f5e6c4d4e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1758 microversion: 2.1 time: 0.180660 May 11 19:02:17.087571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 367/719] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:16 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:17.575980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:17.576497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:17.583490 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:17.584080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:17.584965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:17.585475 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:17.715959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:17.727799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-74d35a5d-8999-47ad-bf4e-0d12b09cfc53 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.155617 May 11 19:02:17.729238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 353/720] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:17 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:17.862084 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:17.862598 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:17.868978 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:17.869426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:17.870209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:17.870636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:17.932687 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:17.940753 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7ac5664d-d4ef-401e-9935-484c34272537 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1294 microversion: 2.1 time: 0.082747 May 11 19:02:17.941579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 368/721] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:17 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:18.745466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:18.746062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:18.752440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:18.752894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:18.753652 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:18.754088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:18.796016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:18.796511 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:18.804811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:18.805265 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:18.806042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:18.806474 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:18.895411 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:18.903865 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-66bde470-dc9b-48bf-8541-489b073a3ed6 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.162280 May 11 19:02:18.904738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 354/722] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:18 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:18.933902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lazy-loading 'services' on Instance uuid 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:02:18.958489 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:18.959275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:18.965380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:18.965837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:18.966610 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:18.967048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:19.039116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:19.049720 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b97cf19c-d123-4ecc-9637-033d794c94d3 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1300 microversion: 2.1 time: 0.094972 May 11 19:02:19.050296 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 355/723] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:18 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:19.061380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9cb742b3-f7a8-4553-a5cb-b5e8788f066f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-volume_attachments/86e9de11-fd03-475f-93da-fe8773b17d8d" status: 202 len: 0 microversion: 2.1 time: 0.269049 May 11 19:02:19.061965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 369/724] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:02:18 2022] DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-volume_attachments/86e9de11-fd03-475f-93da-fe8773b17d8d => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:02:19.868604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-11e90fc3-011d-42d8-a938-ea8f86673dd9 req-5352893f-623f-4bef-9857-41ac1c1d90f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ab7e74-4252-4c1c-93c0-321e87317c2e", "tag": "15caf110-6241-4b8c-b213-436076569974"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:19.877283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-11e90fc3-011d-42d8-a938-ea8f86673dd9 req-5352893f-623f-4bef-9857-41ac1c1d90f7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:19.877981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-11e90fc3-011d-42d8-a938-ea8f86673dd9 req-5352893f-623f-4bef-9857-41ac1c1d90f7 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:19.897229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-11e90fc3-011d-42d8-a938-ea8f86673dd9 req-5352893f-623f-4bef-9857-41ac1c1d90f7 service nova] Creating event network-changed:15caf110-6241-4b8c-b213-436076569974 for instance 98ab7e74-4252-4c1c-93c0-321e87317c2e on hv-cinder-75510 May 11 19:02:19.902946 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-11e90fc3-011d-42d8-a938-ea8f86673dd9 req-5352893f-623f-4bef-9857-41ac1c1d90f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038027 May 11 19:02:19.903923 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 356/725] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:19.924395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:19.925336 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:19.931739 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:19.932186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:19.932973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:19.933409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:20.066703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:20.067422 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:20.073912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:20.074367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:20.075135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:20.075601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:20.213293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:20.221211 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-846b886c-c48c-4f3b-b47b-862983556a59 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.158578 May 11 19:02:20.222516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 357/726] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:20 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:20.224022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:20.233024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-46da8181-59b9-4998-8b4e-4cb3fd1f016d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.314910 May 11 19:02:20.233808 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 370/727] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:19 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:21.238369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:21.238983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:21.241764 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a36fdc67-d74c-4a91-a87a-d3d2ed8eeba3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:21.245617 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.246069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.246842 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.247285 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.248613 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a36fdc67-d74c-4a91-a87a-d3d2ed8eeba3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.249132 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a36fdc67-d74c-4a91-a87a-d3d2ed8eeba3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.270981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a36fdc67-d74c-4a91-a87a-d3d2ed8eeba3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Going to try to stop instance {{(pid=117096) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 19:02:21.314432 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a36fdc67-d74c-4a91-a87a-d3d2ed8eeba3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action" status: 202 len: 0 microversion: 2.1 time: 0.076535 May 11 19:02:21.315042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 371/728] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:02:21 2022] POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:02:21.322344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:21.323050 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:21.329342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.329798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.330575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.331014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.377582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:21.384728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-88ea3afb-7702-49a9-81e1-4ecd599b8848 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.150705 May 11 19:02:21.385290 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 358/729] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:21 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:21.396027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:21.396632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:21.402402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.402850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.403658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:21.404091 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:21.461067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:21.469867 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0647ccf4-42da-46ec-b09a-37fbc4c46d14 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.153660 May 11 19:02:21.470444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 372/730] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:21 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:21.534975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:21.542510 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2ff150ab-bf4a-4f16-bd01-31d344d61927 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.150175 May 11 19:02:21.543076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 359/731] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:21 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:22.401358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:22.401968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:22.409103 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:22.409554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:22.410924 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:22.411401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:22.486003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:22.486642 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:22.493116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:22.493562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:22.494326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:22.494759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:22.543916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:22.553356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-28ef09ef-d5a3-47e1-bb07-f9313b3e46f9 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.155806 May 11 19:02:22.554142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 373/732] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:22 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:22.567666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:22.568378 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:22.574723 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:22.575180 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:22.576001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:22.576443 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:22.634615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:22.642998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-78e3b730-da10-4454-94f7-da6f1d8dc769 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.160953 May 11 19:02:22.643596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 360/733] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:22 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:22.706614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:22.714080 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-067ef40f-ac70-4a89-900c-27f6d1239113 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.152709 May 11 19:02:22.714643 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 374/734] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:22 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:23.570600 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:23.571166 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:23.577482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:23.577926 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:23.578684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:23.579116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:23.660996 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:23.661626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:23.667979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:23.668419 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:23.669176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:23.669609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:23.707836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:23.715381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-75081a9c-503f-454f-b456-4830d416452e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.148850 May 11 19:02:23.715979 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 361/735] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:23 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:23.731352 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:23.732203 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:23.738577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:23.739029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:23.739828 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:23.740270 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:23.806139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:23.814479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cceeb36e-1fbc-4678-b2f0-70c6c4a92870 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.157305 May 11 19:02:23.815050 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 375/736] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:23 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:23.867809 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:23.875600 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-458bedcc-01a6-40bc-bd83-8891ba949c95 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.147357 May 11 19:02:23.876169 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 362/737] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:23 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:24.732775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:24.733561 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:24.740099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:24.740668 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:24.741481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:24.742003 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:24.831578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:24.832268 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:24.838856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:24.839324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:24.840130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:24.840567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:24.874872 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:24.882203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-87264ed4-c79e-4367-9cb7-420ac0cba02e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.153376 May 11 19:02:24.882775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 376/738] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:24 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:24.896640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:24.897240 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:24.903059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:24.903546 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:24.904310 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:24.904740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:24.973695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:24.981443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a0e7250c-7491-44a0-bdb4-ce67c795d32e tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.154180 May 11 19:02:24.982002 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 363/739] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:24 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:25.030016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:25.037834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-552bb23a-4415-4763-a1e8-260cd06c636f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.144833 May 11 19:02:25.038403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 377/740] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:24 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:25.899233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:25.899874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:25.906741 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:25.907184 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:25.907972 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:25.908401 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:25.997860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:25.998461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:26.005259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:26.005710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:26.006517 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:26.006986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:26.042086 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:26.051684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-56ae2143-60da-4adf-9664-54c0eec4823b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.156107 May 11 19:02:26.052464 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 364/741] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:25 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:26.056806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:26.057403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:26.063337 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:26.063786 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:26.064538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:26.064965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:26.136723 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:26.144772 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f01070af-9e58-4be7-aca6-12f9de9366f4 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.150723 May 11 19:02:26.145340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 378/742] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:25 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:26.191317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:26.198937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6883d02d-fbc0-4db1-9d50-cf75d8f12fcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.145696 May 11 19:02:26.199531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 365/743] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:26 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:26.731464 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-96cec089-3032-46a0-896d-f3bbf9923152 req-ff014bc8-27a4-4c26-9c06-4963b7f3d6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ab7e74-4252-4c1c-93c0-321e87317c2e", "name": "network-vif-plugged", "status": "completed", "tag": "15caf110-6241-4b8c-b213-436076569974"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:26.739522 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-96cec089-3032-46a0-896d-f3bbf9923152 req-ff014bc8-27a4-4c26-9c06-4963b7f3d6e9 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:26.739978 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-96cec089-3032-46a0-896d-f3bbf9923152 req-ff014bc8-27a4-4c26-9c06-4963b7f3d6e9 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:26.751359 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-96cec089-3032-46a0-896d-f3bbf9923152 req-ff014bc8-27a4-4c26-9c06-4963b7f3d6e9 service nova] Creating event network-vif-plugged:15caf110-6241-4b8c-b213-436076569974 for instance 98ab7e74-4252-4c1c-93c0-321e87317c2e on hv-cinder-75510 May 11 19:02:26.756191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-96cec089-3032-46a0-896d-f3bbf9923152 req-ff014bc8-27a4-4c26-9c06-4963b7f3d6e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028915 May 11 19:02:26.756962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 379/744] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:27.069293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:27.069895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:27.076996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:27.077478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:27.078601 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:27.079037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:27.162987 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:27.163734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:27.169929 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:27.170382 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:27.171159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:27.171627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:27.213115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:27.220420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ac7b8af8-a372-4a10-8d57-932a69d81194 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.155437 May 11 19:02:27.220999 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 366/745] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:27 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:27.225473 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:27.226065 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:27.231804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:27.232246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:27.233032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:27.233463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:27.332065 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:27.340300 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6b190565-05fb-436e-8f13-c7ab21f8df94 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1735 microversion: 2.1 time: 0.181939 May 11 19:02:27.341036 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 380/746] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:27 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:27.364023 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:27.373438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fb1e69b5-1dcf-4eb0-8626-89f331311938 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.150815 May 11 19:02:27.374041 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 367/747] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:27 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:28.237063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:28.237675 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:28.244246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.244696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.245456 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.245891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.357961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:28.358557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:28.365119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.365559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.366318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.366755 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.402920 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:28.410174 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f099330d-2a3b-4f7c-959c-94cba32f81b1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.176943 May 11 19:02:28.410739 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 381/748] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:28 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:28.415082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:28.415696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:28.421418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.421897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.422662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.423091 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.503960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:28.518435 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ce0f5478-1d0b-4d93-bb02-b87e28bad385 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1715 microversion: 2.1 time: 0.164357 May 11 19:02:28.519326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 368/749] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:28 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:28.554779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:28.563085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-60495647-4f21-4bbd-93b9-92130851f864 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.150824 May 11 19:02:28.563693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 382/750] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:28 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:28.620140 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:28.620623 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:28.627150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.627618 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.628379 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.628806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.704893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] HTTP exception thrown: Cannot 'detach_volume' instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb while it is in vm_state rescued May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Request method failure captured: May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments/fa2a133a-be48-43ba-9780-394ec9e012e2 HTTP/1.1 May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcsGGgWD9RNIHOPFUGdk8L2sOaCDc95Cdt0R2wHKl6Mw__4fqbGLhBEyF7868GENhFJXpC-ojSKj0f9z4-_Y73kLdHW7e8kOxxf-A0GFvFoB1Vk5VAu4stie31mIIy8PVl6l_1mY9RqmllOzp57kIfaMLiQSH30_t9aedi7q3UCoqc May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:02:28.706500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d22bd9d4df840c1af348b3f257593a3", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: c9d83909ea2943f5834778a2a9aa1485 May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:02:28.708022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Cannot 'detach_volume' instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb while it is in vm_state rescued May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'server_id': '7e73aaf5-ec3f-4e29-8e67-597130c372fb', 'id': 'fa2a133a-be48-43ba-9780-394ec9e012e2'} May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb in vm_state rescued. Cannot detach_volume while the instance is in this state. May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:02:28.708753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb while it is in vm_state rescued May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb while it is in vm_state rescued May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:02:28.710171 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Returning 409 to user: Cannot 'detach_volume' instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb while it is in vm_state rescued {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:02:28.711340 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9adfae00-0d57-40ed-a915-f063afde05ce tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments/fa2a133a-be48-43ba-9780-394ec9e012e2" status: 409 len: 152 microversion: 2.1 time: 0.091692 May 11 19:02:28.711340 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 369/751] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:02:28 2022] DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments/fa2a133a-be48-43ba-9780-394ec9e012e2 => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 19:02:28.716786 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:28.717317 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:28.723178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.723668 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.724433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.724869 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.787081 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cae1cc12-0b78-4652-a473-f1da05931f97 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "POST /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/action" status: 202 len: 0 microversion: 2.1 time: 0.073915 May 11 19:02:28.787904 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 383/752] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:02:28 2022] POST /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:02:28.795673 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:28.796281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:28.802656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.803099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.803904 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:28.804341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:28.936504 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:28.944524 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-92ac9541-8092-419c-8afc-e64fdd06f02a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1723 microversion: 2.1 time: 0.152376 May 11 19:02:28.945084 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 370/753] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:28 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:29.426844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:29.427614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:29.433697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:29.434140 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:29.434890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:29.435332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:29.580881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:29.581520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:29.588130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:29.588576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:29.589373 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:29.589917 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:29.635961 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:29.645251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5f287fa9-74f5-4562-8efa-be4a6ebe3351 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1368 microversion: 2.1 time: 0.222885 May 11 19:02:29.646059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 384/754] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:29 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:29.716869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:29.724362 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-63b0e951-9b42-43f3-a5fe-a8eb328e30cd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.148063 May 11 19:02:29.724939 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 371/755] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:29 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:29.961864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:29.962477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:29.968381 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:29.968829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:29.969585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:29.970023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.094691 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:30.102367 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fcfc2c82-0fe6-4a6f-91c7-2577f82b712a tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1723 microversion: 2.1 time: 0.144382 May 11 19:02:30.102939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 385/756] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:29 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:30.662101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:30.662889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:30.669270 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:30.669943 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.670717 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:30.671149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.741485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:30.742756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:30.749362 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:30.750390 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.751174 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:30.751638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.817331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:30.824933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-13345806-deaa-466c-9c6b-6949c90f5046 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1558 microversion: 2.1 time: 0.166731 May 11 19:02:30.825497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 372/757] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:30 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:30.841255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:30.841653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:30.847383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:30.847835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.848589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:30.849023 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:30.925320 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-54e09530-dc28-410f-b2d8-e20b60cc0eb5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087846 May 11 19:02:30.925918 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 373/758] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 19:02:30 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:30.957069 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:30.964581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0efb0261-dbfe-49d7-ad55-16d32e638283 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.227062 May 11 19:02:30.965150 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 386/759] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:30 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:31.120186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:31.120715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:31.131194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:31.131602 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.132002 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:31.132150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.132933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.133378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.138440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.139005 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.140024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.140588 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.169736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5611270f-1c9b-4413-8e19-de9b55c7816a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments/b9d68c6f-3792-449a-b7e0-6cc5d0608927" status: 200 len: 194 microversion: 2.20 time: 0.042803 May 11 19:02:31.170332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 387/760] 10.222.0.93 () {60 vars in 1453 bytes} [Wed May 11 19:02:31 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments/b9d68c6f-3792-449a-b7e0-6cc5d0608927 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 19:02:31.235867 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:31.236450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:31.242235 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.242677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.243471 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.243902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.321404 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lazy-loading 'services' on Instance uuid 03cc433d-eca3-41fe-9a3a-45e94cd562fd {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:02:31.362388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:31.370753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-42455daf-035c-4a9d-a31a-732eb57d7f0d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1723 microversion: 2.1 time: 0.254520 May 11 19:02:31.371644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 374/761] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:31 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:31.396091 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-499ca2c3-7e53-4a41-8910-d3ddcf46b77a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments/b9d68c6f-3792-449a-b7e0-6cc5d0608927" status: 202 len: 0 microversion: 2.20 time: 0.164865 May 11 19:02:31.396677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 388/762] 10.222.0.93 () {60 vars in 1456 bytes} [Wed May 11 19:02:31 2022] DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments/b9d68c6f-3792-449a-b7e0-6cc5d0608927 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 19:02:31.405033 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:31.406567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:31.412326 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.412768 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.413516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.413945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.443767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-058264b0-06c2-4d2a-8577-cc2dac48227f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042624 May 11 19:02:31.446507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 375/763] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:02:31 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 19:02:31.972265 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-e572e57f-9218-41db-8ced-5a229baef34c req-a5cf8a58-bb7f-40d8-b0e0-e026fa76f23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ab7e74-4252-4c1c-93c0-321e87317c2e", "tag": "15caf110-6241-4b8c-b213-436076569974"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:31.981166 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-e572e57f-9218-41db-8ced-5a229baef34c req-a5cf8a58-bb7f-40d8-b0e0-e026fa76f23e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.981445 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:31.981873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-e572e57f-9218-41db-8ced-5a229baef34c req-a5cf8a58-bb7f-40d8-b0e0-e026fa76f23e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.982065 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:31.990059 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.990511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.991272 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:31.991904 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:31.993068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-e572e57f-9218-41db-8ced-5a229baef34c req-a5cf8a58-bb7f-40d8-b0e0-e026fa76f23e service nova] Creating event network-changed:15caf110-6241-4b8c-b213-436076569974 for instance 98ab7e74-4252-4c1c-93c0-321e87317c2e on hv-cinder-75510 May 11 19:02:31.999472 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-e572e57f-9218-41db-8ced-5a229baef34c req-a5cf8a58-bb7f-40d8-b0e0-e026fa76f23e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 May 11 19:02:32.000432 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 389/764] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:32.120714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:32.128157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a68c1ffd-b125-4065-990a-de45c3f08ad0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.150540 May 11 19:02:32.128732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 376/765] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:31 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:32.389477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:32.390089 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:32.397030 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:32.397479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:32.398295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:32.398732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:32.456323 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:32.457414 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:32.464127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:32.464577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:32.465349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:32.465859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:32.499103 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-30fd15cc-bbd8-4518-9b7a-5eefa4a4b840 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047226 May 11 19:02:32.501538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 377/766] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:02:32 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 19:02:32.546838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:32.554699 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e3209609-b7ba-466f-ab91-9428aeb44d3b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1723 microversion: 2.1 time: 0.169645 May 11 19:02:32.555266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 390/767] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:32 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:33.145199 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:33.145809 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:33.152404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.152911 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.153859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.154301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.447639 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:33.455431 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3cf58d21-f538-4444-8c96-c9c665dbf0ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1676 microversion: 2.1 time: 0.314033 May 11 19:02:33.455991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 378/768] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:33 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1676 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:33.512603 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:33.513524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:33.520514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.520959 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.521708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.522137 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.550304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-53858d35-3fa9-431d-9ada-bc44e7ea6a4f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041763 May 11 19:02:33.551126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 391/769] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:02:33 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 19:02:33.572687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:33.573528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:33.580327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.580920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.581658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.582099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.709068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:33.717014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-54bf1197-006d-4cc6-9fa3-96afaf457491 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1729 microversion: 2.1 time: 0.148526 May 11 19:02:33.717694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 379/770] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:33 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:02:33.734562 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:33.735054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:33.741174 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.741629 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.743696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:33.744164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:33.881939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9634e4db-63c8-473b-9ebc-06f8b6f608c8 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151841 May 11 19:02:33.882535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 392/771] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 19:02:33 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:34.472912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:34.473446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:34.479735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.480182 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.480943 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.481376 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.562498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:34.564209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:34.571398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.572209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.573168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.573724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.606214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-35110a9e-63b4-4f08-b284-d182a0012ae3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048484 May 11 19:02:34.606794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 393/772] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:02:34 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 19:02:34.625500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:34.632813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c490c6c0-3090-401b-8709-d927d7a65291 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1653 microversion: 2.1 time: 0.164399 May 11 19:02:34.633671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 380/773] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:34 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1653 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:34.649750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0e498a5b-dd95-48e5-ad78-b2a592f13e99 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:34.655611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0e498a5b-dd95-48e5-ad78-b2a592f13e99 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.656635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0e498a5b-dd95-48e5-ad78-b2a592f13e99 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.678321 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0e498a5b-dd95-48e5-ad78-b2a592f13e99 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Going to try to start instance {{(pid=117096) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 19:02:34.720000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0e498a5b-dd95-48e5-ad78-b2a592f13e99 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action" status: 202 len: 0 microversion: 2.1 time: 0.073761 May 11 19:02:34.720608 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 394/774] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:02:34 2022] POST /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:02:34.728710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:34.729249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:34.735600 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.736052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.736848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.737284 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.809186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-859bb720-0ba4-492a-b4a0-e2d182a4fa81 req-eeccea71-0fe0-449b-a0ac-bb6379b5af0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73aaf5-ec3f-4e29-8e67-597130c372fb", "tag": "881f218e-3373-430b-89cc-fb0562f0fcfd"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:34.824131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-859bb720-0ba4-492a-b4a0-e2d182a4fa81 req-eeccea71-0fe0-449b-a0ac-bb6379b5af0e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:34.824611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-859bb720-0ba4-492a-b4a0-e2d182a4fa81 req-eeccea71-0fe0-449b-a0ac-bb6379b5af0e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:34.841765 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-859bb720-0ba4-492a-b4a0-e2d182a4fa81 req-eeccea71-0fe0-449b-a0ac-bb6379b5af0e service nova] Creating event network-changed:881f218e-3373-430b-89cc-fb0562f0fcfd for instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb on hv-cinder-75510 May 11 19:02:34.847628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-859bb720-0ba4-492a-b4a0-e2d182a4fa81 req-eeccea71-0fe0-449b-a0ac-bb6379b5af0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043027 May 11 19:02:34.848550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 395/775] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:02:35.120121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:35.127958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-da35053b-b9d6-46d3-943d-5f683f76e8a7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1662 microversion: 2.1 time: 0.403147 May 11 19:02:35.128547 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 381/776] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:34 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1662 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:35.619530 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:35.620832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:35.627092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:35.627878 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:35.628829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:35.629424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:35.666565 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-605cc77e-0a9d-4202-9081-67b055d1fa78 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051863 May 11 19:02:35.667356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 396/777] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:02:35 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 19:02:36.145619 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:36.146226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:36.152498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.152984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.153745 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.154183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.454322 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:36.461669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ece535ff-433a-4c1f-a831-e23ff06b9f5c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1662 microversion: 2.1 time: 0.320043 May 11 19:02:36.462246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 382/778] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:36 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1662 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:36.678770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:36.679740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:36.686122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.686575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.687402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.687846 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.716898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bd9a94c7-b9da-40df-bf61-0dc4c2f8dbdd tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042142 May 11 19:02:36.717463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 397/779] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:02:36 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:36.774311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:36.774831 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:36.781456 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.781821 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.782587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.783022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.808043 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:02:36.864958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-f90fdd81-e2df-478b-a9b8-195987557a00 req-14020a19-b8b2-4442-aafd-273ea0bc8a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73aaf5-ec3f-4e29-8e67-597130c372fb", "tag": "881f218e-3373-430b-89cc-fb0562f0fcfd"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:36.873030 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-f90fdd81-e2df-478b-a9b8-195987557a00 req-14020a19-b8b2-4442-aafd-273ea0bc8a19 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.873478 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-f90fdd81-e2df-478b-a9b8-195987557a00 req-14020a19-b8b2-4442-aafd-273ea0bc8a19 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.884880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-f90fdd81-e2df-478b-a9b8-195987557a00 req-14020a19-b8b2-4442-aafd-273ea0bc8a19 service nova] Creating event network-changed:881f218e-3373-430b-89cc-fb0562f0fcfd for instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb on hv-cinder-75510 May 11 19:02:36.888348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-13e7fe52-2ae5-4281-9f50-e652c66a17ae tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 204 len: 0 microversion: 2.20 time: 0.117421 May 11 19:02:36.889647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 383/780] 10.222.0.93 () {60 vars in 1279 bytes} [Wed May 11 19:02:36 2022] DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 19:02:36.889868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-f90fdd81-e2df-478b-a9b8-195987557a00 req-14020a19-b8b2-4442-aafd-273ea0bc8a19 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028387 May 11 19:02:36.891402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 398/781] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:02:36.899961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:36.900658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:36.907766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.908218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:36.908990 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:36.909420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:37.038520 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:37.046263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:37.047794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:37.048956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-00dac0a7-9639-4944-be8d-513e4a66b284 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.153434 May 11 19:02:37.049516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 384/782] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:36 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:37.480007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:37.480623 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:37.487263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:37.487738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:37.488508 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:37.488942 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:37.612886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:37.620413 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-902ad8e3-bfd3-48d1-99e9-f2cd580a4d14 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1662 microversion: 2.1 time: 0.144797 May 11 19:02:37.620981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 399/783] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:37 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1662 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:38.067847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:38.068453 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:38.075029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:38.075518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:38.076283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:38.076719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:38.207135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:38.214969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:38.216509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:38.217661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cfe5d250-6361-4454-98f5-ba2a4b89d2d4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.153776 May 11 19:02:38.218219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 385/784] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:38 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:38.637846 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:38.638454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:38.644864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:38.645309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:38.646072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:38.646505 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:38.774356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:38.782144 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3f9a89a3-aab4-4807-871f-d944b8ff8eeb tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1662 microversion: 2.1 time: 0.148141 May 11 19:02:38.782709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 400/785] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:38 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:39.236281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:39.236916 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:39.243369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:39.243813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:39.244570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:39.245032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:39.379802 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:39.387529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:39.389048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:39.390200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d429e842-1360-4c83-9f35-bbee369f8847 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.158290 May 11 19:02:39.390758 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 386/786] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:39 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:39.798667 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:39.799264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:39.805586 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:39.806033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:39.806785 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:39.807215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:39.932986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:39.940223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e82e686e-e7a3-4e09-b6d0-14a2e247bad8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1666 microversion: 2.1 time: 0.145535 May 11 19:02:39.940778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 401/787] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:02:39 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1666 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:02:40.408354 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:40.408964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:40.415315 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:40.415779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:40.416542 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:40.416981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:40.734689 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:40.743540 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:40.745357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:40.746850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-62ca413c-d67e-4818-a290-5f68d056bbb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1722 microversion: 2.20 time: 0.342346 May 11 19:02:40.748361 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 387/788] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:40 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:41.554070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-d0ffa7a2-5750-4543-8c1d-85f68f1b2aa8 req-c14b0188-b56d-4006-a9f9-d04f82573078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc433d-eca3-41fe-9a3a-45e94cd562fd", "name": "network-vif-deleted", "tag": "41ca2308-662f-4053-aa41-946ed26af250"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:41.567696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-d0ffa7a2-5750-4543-8c1d-85f68f1b2aa8 req-c14b0188-b56d-4006-a9f9-d04f82573078 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:41.568234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-d0ffa7a2-5750-4543-8c1d-85f68f1b2aa8 req-c14b0188-b56d-4006-a9f9-d04f82573078 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:41.580128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-d0ffa7a2-5750-4543-8c1d-85f68f1b2aa8 req-c14b0188-b56d-4006-a9f9-d04f82573078 service nova] Creating event network-vif-deleted:41ca2308-662f-4053-aa41-946ed26af250 for instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd on hv-cinder-75510 May 11 19:02:41.585262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-d0ffa7a2-5750-4543-8c1d-85f68f1b2aa8 req-c14b0188-b56d-4006-a9f9-d04f82573078 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041751 May 11 19:02:41.585943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 402/789] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:41.767039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:41.768073 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:41.774650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:41.775102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:41.775903 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:41.776333 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:41.806732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:41.807175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:41.807642 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lazy-loading 'fault' on Instance uuid 03cc433d-eca3-41fe-9a3a-45e94cd562fd {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:02:41.849732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:41.857392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:41.858922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:41.860095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-20fccba5-2d7b-4082-bd41-00619ba92e74 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 200 len: 1371 microversion: 2.20 time: 0.097684 May 11 19:02:41.860656 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 388/790] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:41 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:42.879198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:42.879818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:42.886259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:42.886701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:42.887490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:42.887917 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:42.901481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] HTTP exception thrown: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Request method failure captured: May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd HTTP/1.1 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcoB2-4OF7shp-U2O-3E_zx_ot9bp4I5M2luUHJHE-6uWS4VH--IYvgFwTuAldpdLfjYziajlFngOQKBAW_2fq44jN8nyT8koNiwCrqOGweUziMz8vnScbUyyzBMaEY0krLj8um6pqbcjTS5i5-lMMWbMaifxW3iXAfxdZzJSzApRQ May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Openstack-Nova-Api-Version: 2.20 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:02:42.903076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9e2d6a4c01b04940b13d9f1ca40bd778", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 378aab35909343d88c0250493e41be34 May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:02:42.904701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '03cc433d-eca3-41fe-9a3a-45e94cd562fd'} May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:02:42.906282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:02:42.907780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:02:42.909206 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Returning 404 to user: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:02:42.909206 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-35bb4742-085b-47ef-b073-8734c25feda0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 404 len: 111 microversion: 2.20 time: 0.030135 May 11 19:02:42.909206 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 403/791] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:42 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 19:02:42.914369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-07148740-690c-454b-ba8c-eb0102054c2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '.version_select at 0x7fa7874c84c0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:42.931069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-07148740-690c-454b-ba8c-eb0102054c2b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622915487" status: 204 len: 0 microversion: 2.20 time: 0.020472 May 11 19:02:42.931669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 389/792] 10.222.0.93 () {60 vars in 1261 bytes} [Wed May 11 19:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622915487 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 19:02:43.547011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a7a01050-e16f-4302-843b-c84392793e0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'create', calling method: .version_select at 0x7fa79079b9d0>, body: {"keypair": {"name": "tempest-keypair-1620339233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHFnTR302J7JVBC701k6WQ8KPKrnS0V0VwZK3aUIejx9tvL11SXb0Wti2lFTB8NmtWqrYx002pImKtubDg2HJu8boLermNj02/KOac3hU1m1efDkxqNEGmLU6g443j2Dw=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:43.560901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-a7a01050-e16f-4302-843b-c84392793e0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:02:43.565785 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-a7a01050-e16f-4302-843b-c84392793e0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for user 378aab35909343d88c0250493e41be34 and project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:02:43.587459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a7a01050-e16f-4302-843b-c84392793e0d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044938 May 11 19:02:43.588041 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 404/793] 10.222.0.93 () {62 vars in 1199 bytes} [Wed May 11 19:02:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 19:02:45.113667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1324233672", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c9ab2fe-9057-4e17-9b0a-c8025b25ad2a"}], "security_groups": [{"name": "tempest-securitygroup--183453850"}], "key_name": "tempest-keypair-1620339233", "user_data": "}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:45.211343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] validate_networks() for [('5c9ab2fe-9057-4e17-9b0a-c8025b25ad2a', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:02:45.566478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:02:45.567240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:02:45.567753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:02:45.568156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:02:45.568588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:02:45.578728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:45.579574 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:45.580924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:45.581781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:45.598499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:02:45.602281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Getting quotas for user 378aab35909343d88c0250493e41be34 and project 9e2d6a4c01b04940b13d9f1ca40bd778. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:02:45.613327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:02:45.615550 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:02:45.667500 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-68d8d4fd-48a8-4321-9de4-683a6ef7b9e1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.609704 May 11 19:02:45.671805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 390/794] 10.222.0.93 () {62 vars in 1187 bytes} [Wed May 11 19:02:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 19:02:45.678657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3f3f6127-4770-4e7d-83c4-b5e76d1bcaa4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:45.679266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3f3f6127-4770-4e7d-83c4-b5e76d1bcaa4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:45.734402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3f3f6127-4770-4e7d-83c4-b5e76d1bcaa4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:45.741590 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3f3f6127-4770-4e7d-83c4-b5e76d1bcaa4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:45.743088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3f3f6127-4770-4e7d-83c4-b5e76d1bcaa4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:45.744212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3f3f6127-4770-4e7d-83c4-b5e76d1bcaa4 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1282 microversion: 2.20 time: 0.069471 May 11 19:02:45.744783 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 405/795] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:45 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:46.763434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:46.764048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:46.771042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:46.771522 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:46.772292 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:46.772729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:46.834364 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:46.842531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:46.844558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:46.845739 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1cc6b3a1-e2fc-4807-8023-d9221592d4a3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1334 microversion: 2.20 time: 0.087102 May 11 19:02:46.846293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 391/796] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:46 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:47.863937 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:47.864529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:47.872688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:47.873238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:47.874637 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:47.875184 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:48.091289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:48.099181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:48.100808 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:48.101914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-944253f1-6edd-4daf-9d7d-c12238bb0f32 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.241869 May 11 19:02:48.102463 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 406/797] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:47 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:48.434885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-aacc2a7a-a175-4e90-ba4b-17e6c9d05c79 req-02e22508-857d-4337-a255-a40174b93d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:48.445234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-aacc2a7a-a175-4e90-ba4b-17e6c9d05c79 req-02e22508-857d-4337-a255-a40174b93d31 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:48.445900 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-aacc2a7a-a175-4e90-ba4b-17e6c9d05c79 req-02e22508-857d-4337-a255-a40174b93d31 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:48.473528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-aacc2a7a-a175-4e90-ba4b-17e6c9d05c79 req-02e22508-857d-4337-a255-a40174b93d31 service nova] Creating event network-changed:4835742f-ec35-4b97-b6e6-227ad8b350fb for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 on hv-cinder-75510 May 11 19:02:48.478843 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-aacc2a7a-a175-4e90-ba4b-17e6c9d05c79 req-02e22508-857d-4337-a255-a40174b93d31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047544 May 11 19:02:48.480029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 392/798] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:49.120540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:49.121068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:49.128044 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:49.128496 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:49.129276 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:49.129707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:49.256640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:49.264394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:49.266506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:49.267684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0686ded4-d792-4816-8993-70b0a6f73961 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.151078 May 11 19:02:49.268244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 407/799] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:49 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:50.286486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:50.287275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:50.293798 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:50.294240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:50.294996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:50.295462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:50.432648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:50.440598 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:50.442145 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:50.443253 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1e562ff6-f760-41b3-aea1-73fe29caa990 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.160961 May 11 19:02:50.444101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 393/800] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:50 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:51.461509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:51.462037 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:51.468440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:51.469395 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:51.470162 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:51.470598 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:51.595363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:51.603064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:51.604604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:51.605715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a87a0ef5-7367-47f5-a5d8-91e01e72a8bc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.148243 May 11 19:02:51.606269 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 408/801] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:51 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:02:52.623226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:52.623864 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:52.630785 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:52.631231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:52.632023 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:52.632460 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:52.763218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:52.772031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:52.773814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:52.774937 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cdbcaec6-21c2-4ae3-913a-0218733bf73f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.155607 May 11 19:02:52.775777 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 394/802] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:52 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:53.793450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:53.794059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:53.800602 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:53.801052 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:53.801824 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:53.802266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:53.930264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:53.938150 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:53.940246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:53.941353 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a186dfb6-3b1c-4113-8a12-fb5193f46c9f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.151809 May 11 19:02:53.942047 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 409/803] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:53 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:54.863433 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-a5d78558-3325-49a8-8ed6-fc1816c1ee75 req-7258cdd4-2f44-4e40-b236-5f4483f3285e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "name": "network-vif-plugged", "status": "completed", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:54.871663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-a5d78558-3325-49a8-8ed6-fc1816c1ee75 req-7258cdd4-2f44-4e40-b236-5f4483f3285e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:54.872107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-a5d78558-3325-49a8-8ed6-fc1816c1ee75 req-7258cdd4-2f44-4e40-b236-5f4483f3285e service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:54.882980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-a5d78558-3325-49a8-8ed6-fc1816c1ee75 req-7258cdd4-2f44-4e40-b236-5f4483f3285e service nova] Creating event network-vif-plugged:4835742f-ec35-4b97-b6e6-227ad8b350fb for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 on hv-cinder-75510 May 11 19:02:54.887878 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-a5d78558-3325-49a8-8ed6-fc1816c1ee75 req-7258cdd4-2f44-4e40-b236-5f4483f3285e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028187 May 11 19:02:54.888521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 395/804] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:02:54.959968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:54.960576 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:54.967023 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:54.967502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:54.968273 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:54.968703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:55.104435 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:55.112210 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:55.113759 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:55.114795 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cede120e-d429-4f5f-8bfa-44169d0e50cc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.158801 May 11 19:02:55.115382 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 410/805] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:54 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:56.133627 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:56.134311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:56.140437 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:56.140878 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:56.142140 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:56.142568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:56.272667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:56.280297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:56.281763 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:56.283438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-02fc09bf-6663-4fe3-9458-b8fd9e26b25d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.154434 May 11 19:02:56.283986 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 396/806] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:56 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:57.301594 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:57.302191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:57.308585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:57.309054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:57.309809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:57.310238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:57.443218 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:57.451186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:57.452704 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:57.453803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-da6d2a32-0b2a-45e6-bc1e-0a81c4c29290 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1407 microversion: 2.20 time: 0.156616 May 11 19:02:57.454368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 411/807] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:57 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:58.471686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:58.472215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:58.478488 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:58.478930 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:58.479705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:58.480135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:58.606036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:58.614319 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:58.615825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:02:58.616956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c03fedc3-104a-47c1-bfdd-a7bf2ccabce0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1599 microversion: 2.20 time: 0.149320 May 11 19:02:58.617508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 397/808] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:02:58 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:02:58.634556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:02:58.635048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:02:58.641377 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:58.641828 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:58.642592 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:58.643032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:58.716899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e8b3d237-ada7-4fe7-9cae-7ec5c12a3980 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086109 May 11 19:02:58.717480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 412/809] 10.222.0.93 () {60 vars in 1315 bytes} [Wed May 11 19:02:58 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 19:02:59.688755 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-8db88ce8-4eac-4867-a0f4-64334e9c8fa0 req-6fc870cc-0612-44d7-be66-ab131ee62415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:02:59.697612 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-8db88ce8-4eac-4867-a0f4-64334e9c8fa0 req-6fc870cc-0612-44d7-be66-ab131ee62415 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:02:59.698059 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-8db88ce8-4eac-4867-a0f4-64334e9c8fa0 req-6fc870cc-0612-44d7-be66-ab131ee62415 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:02:59.709707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-8db88ce8-4eac-4867-a0f4-64334e9c8fa0 req-6fc870cc-0612-44d7-be66-ab131ee62415 service nova] Creating event network-changed:4835742f-ec35-4b97-b6e6-227ad8b350fb for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 on hv-cinder-75510 May 11 19:02:59.714721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-8db88ce8-4eac-4867-a0f4-64334e9c8fa0 req-6fc870cc-0612-44d7-be66-ab131ee62415 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030190 May 11 19:02:59.715336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 398/810] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:08.663907 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1633907755"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:08.664442 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:08.670377 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:08.670827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:08.671615 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:08.672051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:08.798778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.network.security_group_api [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Removing security group e82cfbde-02f9-4feb-a552-e798d6aef456 from port 3f7b9c68-8d57-4c3e-aa14-d14169f7215f May 11 19:03:09.175094 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-82765268-e971-4076-8de6-cfcc32375b21 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/action" status: 202 len: 0 microversion: 2.1 time: 0.515588 May 11 19:03:09.175816 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 413/811] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:03:08 2022] POST /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:09.270133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-4fd1bd40-64be-4337-a35b-76ec744049b9 req-2d15d452-15d9-40c6-8730-69cdb5823089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:09.280233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-4fd1bd40-64be-4337-a35b-76ec744049b9 req-2d15d452-15d9-40c6-8730-69cdb5823089 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:09.280689 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-4fd1bd40-64be-4337-a35b-76ec744049b9 req-2d15d452-15d9-40c6-8730-69cdb5823089 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:09.292947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-4fd1bd40-64be-4337-a35b-76ec744049b9 req-2d15d452-15d9-40c6-8730-69cdb5823089 service nova] Creating event network-changed:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:03:09.298886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-4fd1bd40-64be-4337-a35b-76ec744049b9 req-2d15d452-15d9-40c6-8730-69cdb5823089 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118093 May 11 19:03:09.299912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 399/812] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:10.854217 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:10.854715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:10.861281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:10.861730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:10.862487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:10.862918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:10.941212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lazy-loading 'services' on Instance uuid 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:11.014571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-46575ec7-adea-4fd4-aaf5-4cac912a70b0 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments/d9064ad9-d7da-49ad-9517-e14fb79e8571" status: 202 len: 0 microversion: 2.1 time: 0.164573 May 11 19:03:11.015211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 414/813] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:03:10 2022] DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments/d9064ad9-d7da-49ad-9517-e14fb79e8571 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:11.024540 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:11.025540 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:11.032641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:11.033094 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:11.033887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:11.034294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:11.064380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-58f8fee4-394a-450b-a396-ff5db127944b tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 May 11 19:03:11.064844 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 400/814] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:11 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:11.313932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-97679667-48ac-4e09-b192-4509b56984b0 req-69338d56-883c-4c33-9bb8-bffd49a4ec00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:11.323060 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-97679667-48ac-4e09-b192-4509b56984b0 req-69338d56-883c-4c33-9bb8-bffd49a4ec00 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:11.323545 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-97679667-48ac-4e09-b192-4509b56984b0 req-69338d56-883c-4c33-9bb8-bffd49a4ec00 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:11.335853 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-97679667-48ac-4e09-b192-4509b56984b0 req-69338d56-883c-4c33-9bb8-bffd49a4ec00 service nova] Creating event network-changed:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:03:11.340812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-97679667-48ac-4e09-b192-4509b56984b0 req-69338d56-883c-4c33-9bb8-bffd49a4ec00 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030867 May 11 19:03:11.341418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 415/815] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:12.077415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:12.078328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:12.084648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:12.085097 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:12.085861 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:12.086297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:12.114683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0e590b74-4e67-4d72-8ee2-9a9853ffc2b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 May 11 19:03:12.115151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 401/816] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:12 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:13.128088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:13.129074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:13.135194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:13.135672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:13.136423 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:13.136849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:13.164109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f4dbe01b-2b17-42e5-b091-d06a100c5d31 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041308 May 11 19:03:13.164629 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 416/817] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:13 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:03:13.174364 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:13.174859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:13.181219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:13.181672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:13.182438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:13.182879 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:13.255678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] HTTP exception thrown: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 is not attached to volume d9064ad9-d7da-49ad-9517-e14fb79e8571 May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Request method failure captured: May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments/d9064ad9-d7da-49ad-9517-e14fb79e8571 HTTP/1.1 May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAeWC-E4-PysgaYq5g-bBPzAtNrU95cFhOqeCyL9x-ebkGPsiTRB75vwf33ZDf44cXkyqrnskDHb5py8Vjn0gkdI4KAThRjerdp4YJ0rfQVH7EMo8uGMLYhgpKxqbJEmy_xb-otCbRmzGOSIwrgSjcJWTrdEZVsnHYERAMOv_476T4w May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 4be93dc182224cfe8be43a23dadbb62f May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-TestMinimumBasicScenario-2014758984 May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:03:13.272283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4be93dc182224cfe8be43a23dadbb62f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4be93dc182224cfe8be43a23dadbb62f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4be93dc182224cfe8be43a23dadbb62f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4be93dc182224cfe8be43a23dadbb62f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-TestMinimumBasicScenario-2014758984 May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 4be93dc182224cfe8be43a23dadbb62f May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014758984 May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-TestMinimumBasicScenario-2014758984-project May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 2558a8c34b324bc99b157b306c9cdf7b May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-TestMinimumBasicScenario-2014758984-project May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:03:13.273684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 is not attached to volume d9064ad9-d7da-49ad-9517-e14fb79e8571 May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'server_id': '4a1e823d-1171-4b7a-bb09-f0f3afde5b14', 'id': 'd9064ad9-d7da-49ad-9517-e14fb79e8571'} May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d9064ad9-d7da-49ad-9517-e14fb79e8571. May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:13.274402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 is not attached to volume d9064ad9-d7da-49ad-9517-e14fb79e8571 May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 is not attached to volume d9064ad9-d7da-49ad-9517-e14fb79e8571 May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:13.275884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Returning 404 to user: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 is not attached to volume d9064ad9-d7da-49ad-9517-e14fb79e8571 {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:13.276987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1cd76727-e225-43e0-ac4f-7cc2990bd85a tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments/d9064ad9-d7da-49ad-9517-e14fb79e8571" status: 404 len: 154 microversion: 2.1 time: 0.103627 May 11 19:03:13.276987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 402/818] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:03:13 2022] DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14/os-volume_attachments/d9064ad9-d7da-49ad-9517-e14fb79e8571 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:14.402038 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:14.402545 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:14.410209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:14.410918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:14.411717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:14.412157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:14.437800 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:03:14.513620 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-30d291b1-0fdd-4fbe-b73c-fb58e3877241 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 204 len: 0 microversion: 2.1 time: 0.114696 May 11 19:03:14.514160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 417/819] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:03:14 2022] DELETE /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:03:14.525365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:14.526000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:14.532965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:14.533405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:14.534172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:14.534604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:14.665238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:14.674842 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9d18eeb4-e829-4b7f-9747-e6fbb927a85e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1553 microversion: 2.1 time: 0.154622 May 11 19:03:14.675565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 403/820] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:14 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:15.694034 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:15.694711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:15.700952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:15.701396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:15.702152 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:15.702582 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:15.836192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:15.843704 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-396f9c14-8378-4d1e-8bd2-255b731e96b2 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1553 microversion: 2.1 time: 0.154149 May 11 19:03:15.844845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 418/821] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:15 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:16.861400 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:16.861995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:16.868324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:16.868714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:16.869468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:16.869893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:16.996736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:17.007440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aaf02e2a-0dad-446c-a4a4-44974f6b746e tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1553 microversion: 2.1 time: 0.149956 May 11 19:03:17.008041 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 404/822] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:16 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:17.419095 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-96d8b4d4-6b1a-4cfc-832f-69ede6b013c3 req-ce825279-f852-40c4-83de-acd61e32d298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1e823d-1171-4b7a-bb09-f0f3afde5b14", "name": "network-vif-deleted", "tag": "3f7b9c68-8d57-4c3e-aa14-d14169f7215f"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:17.427917 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-96d8b4d4-6b1a-4cfc-832f-69ede6b013c3 req-ce825279-f852-40c4-83de-acd61e32d298 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:17.428397 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-96d8b4d4-6b1a-4cfc-832f-69ede6b013c3 req-ce825279-f852-40c4-83de-acd61e32d298 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:17.439725 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-96d8b4d4-6b1a-4cfc-832f-69ede6b013c3 req-ce825279-f852-40c4-83de-acd61e32d298 service nova] Creating event network-vif-deleted:3f7b9c68-8d57-4c3e-aa14-d14169f7215f for instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 on hv-cinder-75510 May 11 19:03:17.444560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-96d8b4d4-6b1a-4cfc-832f-69ede6b013c3 req-ce825279-f852-40c4-83de-acd61e32d298 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028812 May 11 19:03:17.445147 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 419/823] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:18.032993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:18.034504 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:18.041883 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:18.042331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:18.043096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:18.043555 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:18.077471 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:18.077917 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:18.078400 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lazy-loading 'fault' on Instance uuid 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:18.121944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2558a8c34b324bc99b157b306c9cdf7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be93dc182224cfe8be43a23dadbb62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:18.129120 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-92a7137b-5dc7-45e3-a3cf-a4431dddb04d tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 200 len: 1347 microversion: 2.1 time: 0.099990 May 11 19:03:18.129696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 405/824] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:18 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:19.146866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:19.147516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] [instance: 4a1e823d-1171-4b7a-bb09-f0f3afde5b14] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:19.153900 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:19.154354 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:19.155353 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:19.156167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:19.171755 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] HTTP exception thrown: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 could not be found. May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Request method failure captured: May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 HTTP/1.1 May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAeWC-E4-PysgaYq5g-bBPzAtNrU95cFhOqeCyL9x-ebkGPsiTRB75vwf33ZDf44cXkyqrnskDHb5py8Vjn0gkdI4KAThRjerdp4YJ0rfQVH7EMo8uGMLYhgpKxqbJEmy_xb-otCbRmzGOSIwrgSjcJWTrdEZVsnHYERAMOv_476T4w May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 4be93dc182224cfe8be43a23dadbb62f May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-TestMinimumBasicScenario-2014758984 May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:03:19.173411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4be93dc182224cfe8be43a23dadbb62f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4be93dc182224cfe8be43a23dadbb62f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4be93dc182224cfe8be43a23dadbb62f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4be93dc182224cfe8be43a23dadbb62f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-TestMinimumBasicScenario-2014758984 May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 4be93dc182224cfe8be43a23dadbb62f May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014758984 May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-TestMinimumBasicScenario-2014758984-project May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 2558a8c34b324bc99b157b306c9cdf7b May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-TestMinimumBasicScenario-2014758984-project May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 could not be found. May 11 19:03:19.174885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '4a1e823d-1171-4b7a-bb09-f0f3afde5b14'} May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 could not be found. May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:19.175891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 could not be found. May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 could not be found. May 11 19:03:19.177131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:19.178198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Returning 404 to user: Instance 4a1e823d-1171-4b7a-bb09-f0f3afde5b14 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:19.178198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0589199c-a03f-4e00-b4a2-a2c235451664 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14" status: 404 len: 111 microversion: 2.1 time: 0.032852 May 11 19:03:19.178198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 420/825] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:19 2022] GET /compute/v2.1/servers/4a1e823d-1171-4b7a-bb09-f0f3afde5b14 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:19.183945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e8a3c49c-2104-49ac-bbea-ddccefbb3692 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] Calling method '.version_select at 0x7fa78748c280>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:19.204507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e8a3c49c-2104-49ac-bbea-ddccefbb3692 tempest-TestMinimumBasicScenario-2014758984 tempest-TestMinimumBasicScenario-2014758984-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-454194005" status: 202 len: 0 microversion: 2.1 time: 0.024281 May 11 19:03:19.205071 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 406/826] 10.222.0.93 () {58 vars in 1268 bytes} [Wed May 11 19:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-454194005 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:22.260635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:22.261212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:22.267983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:22.268659 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:22.269527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:22.270030 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:22.355121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'services' on Instance uuid 7e73aaf5-ec3f-4e29-8e67-597130c372fb {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:22.430503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8711b2da-6ede-4730-aae8-0916969bb2fb tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments/fa2a133a-be48-43ba-9780-394ec9e012e2" status: 202 len: 0 microversion: 2.1 time: 0.173842 May 11 19:03:22.431709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 421/827] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:03:22 2022] DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments/fa2a133a-be48-43ba-9780-394ec9e012e2 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:22.440177 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:22.441094 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:22.450173 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:22.450814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:22.451667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:22.452201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:22.483036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2dd24dd6-4866-446e-8392-fa11528fbc27 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 May 11 19:03:22.484517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 407/828] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:22 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:23.495486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:23.496508 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:23.504478 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:23.504930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:23.506342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:23.506790 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:23.541096 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-75932323-021d-4790-a944-0a33509705b9 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050355 May 11 19:03:23.541771 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 422/829] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:23 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:03:23.631322 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:23.631880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:23.638298 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:23.638678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:23.639485 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:23.639924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:23.666048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:03:23.743113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5805d644-8109-4e94-beb0-50bd0e8ec346 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 204 len: 0 microversion: 2.1 time: 0.115420 May 11 19:03:23.744246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 408/830] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:03:23 2022] DELETE /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:03:23.753787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:23.754538 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:23.760420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:23.761054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:23.761824 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:23.762261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:23.964828 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:23.972691 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-92912cd4-66bc-4203-ab72-0807ad5087bc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1689 microversion: 2.1 time: 0.223913 May 11 19:03:23.973270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 423/831] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:23 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:24.991221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:24.992807 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:24.999283 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:25.000463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:25.001323 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:25.001835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:25.221633 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:25.229239 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b5367797-4fbd-4884-90c5-ab09ce577485 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1689 microversion: 2.1 time: 0.242347 May 11 19:03:25.230128 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 409/832] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:24 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1689 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:26.247003 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:26.247454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:26.262309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:26.263018 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:26.264073 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:26.264854 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:26.423323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:26.430914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3e7ad7fa-7522-4cd3-84cd-16582212f967 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1689 microversion: 2.1 time: 0.188456 May 11 19:03:26.431516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 424/833] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:26 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:27.448254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:27.449833 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:27.456551 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:27.457068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:27.457992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:27.458479 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:27.472860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:27.473397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:27.480101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:27.480589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:27.481392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:27.481832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:27.509362 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7af6f9a0-f868-4d1a-ac3c-d71c6326b14f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/ips" status: 200 len: 150 microversion: 2.1 time: 0.273814 May 11 19:03:27.510246 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 410/834] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 19:03:27 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/ips => generated 150 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:27.615196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:27.623078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-528455c0-8c4b-4355-a6aa-198f1b54aabc tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1689 microversion: 2.1 time: 0.178546 May 11 19:03:27.631547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 425/835] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:27 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:28.572820 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-da8556d7-4c8d-420a-b93b-88e7a4de1433 req-14e1b6ee-1bea-4846-b523-6dbf877ba19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73aaf5-ec3f-4e29-8e67-597130c372fb", "name": "network-vif-deleted", "tag": "881f218e-3373-430b-89cc-fb0562f0fcfd"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:28.584038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-da8556d7-4c8d-420a-b93b-88e7a4de1433 req-14e1b6ee-1bea-4846-b523-6dbf877ba19d service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:28.584498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-da8556d7-4c8d-420a-b93b-88e7a4de1433 req-14e1b6ee-1bea-4846-b523-6dbf877ba19d service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:28.596357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-da8556d7-4c8d-420a-b93b-88e7a4de1433 req-14e1b6ee-1bea-4846-b523-6dbf877ba19d service nova] Creating event network-vif-deleted:881f218e-3373-430b-89cc-fb0562f0fcfd for instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb on hv-cinder-75510 May 11 19:03:28.601216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-da8556d7-4c8d-420a-b93b-88e7a4de1433 req-14e1b6ee-1bea-4846-b523-6dbf877ba19d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032290 May 11 19:03:28.601923 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 411/836] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:28.641950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:28.642733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:28.650416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:28.655962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:28.657076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:28.658281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:28.732072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:28.741565 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fe120d73-a2da-48b1-a72b-baa3e1720e7d tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 200 len: 1330 microversion: 2.1 time: 0.103768 May 11 19:03:28.742411 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 426/837] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:28 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:28.853720 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57719726-970c-4a2e-a29c-d9aef0fea6ac"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:28.854850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:28.861079 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:28.861530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:28.862292 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:28.862903 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:29.238987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5a9b7eda-aac4-44e8-85a7-b09008b9dde8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389388 May 11 19:03:29.244663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 412/838] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:03:28 2022] POST /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:29.758020 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:29.758581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 7e73aaf5-ec3f-4e29-8e67-597130c372fb] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:29.764893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:29.765363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:29.766229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:29.766703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:29.785352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] HTTP exception thrown: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb could not be found. May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Request method failure captured: May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb HTTP/1.1 May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcsGGgWD9RNIHOPFUGdk8L2sOaCDc95Cdt0R2wHKl6Mw__4fqbGLhBEyF7868GENhFJXpC-ojSKj0f9z4-_Y73kLdHW7e8kOxxf-A0GFvFoB1Vk5VAu4stie31mIIy8PVl6l_1mY9RqmllOzp57kIfaMLiQSH30_t9aedi7q3UCoqc May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:03:29.787012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d22bd9d4df840c1af348b3f257593a3", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: c9d83909ea2943f5834778a2a9aa1485 May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb could not be found. May 11 19:03:29.788614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '7e73aaf5-ec3f-4e29-8e67-597130c372fb'} May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb could not be found. May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:29.789939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb could not be found. May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb could not be found. May 11 19:03:29.791793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:29.793882 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Returning 404 to user: Instance 7e73aaf5-ec3f-4e29-8e67-597130c372fb could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:29.793882 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-78684e42-1775-459b-b336-bd3089a07539 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb" status: 404 len: 111 microversion: 2.1 time: 0.034476 May 11 19:03:29.793882 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 427/839] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:29 2022] GET /compute/v2.1/servers/7e73aaf5-ec3f-4e29-8e67-597130c372fb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:29.800402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f53c2831-3cf2-4482-978d-c62d0716459f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '.version_select at 0x7fa7875db040>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:29.818551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f53c2831-3cf2-4482-978d-c62d0716459f tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902814533" status: 202 len: 0 microversion: 2.1 time: 0.023859 May 11 19:03:29.819436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 413/840] 10.222.0.93 () {58 vars in 1220 bytes} [Wed May 11 19:03:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902814533 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:32.258587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:32.259125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:32.266138 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.266588 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.268210 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.268210 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.292864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lazy-loading 'flavor' on Instance uuid 217567c2-6dbb-4561-ad6e-4aa5229b474b {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:32.362548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9f8fbf9c-daf6-424c-ae87-2380d02bacc4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "POST /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b/action" status: 202 len: 0 microversion: 2.1 time: 0.107686 May 11 19:03:32.363125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 428/841] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:03:32 2022] POST /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:32.372095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:32.372976 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:32.381003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.381527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.382388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.382922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.515364 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:32.522646 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a3ec9574-79c5-4bc5-9f82-bbdae82427f9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.155226 May 11 19:03:32.523208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 414/842] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:32 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:32.647647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:32.648224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:32.654266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.654718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.655519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.656462 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.681567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:03:32.753675 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-97633e84-2aff-42ad-a123-11baa97aa453 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "DELETE /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 204 len: 0 microversion: 2.1 time: 0.109895 May 11 19:03:32.754186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 429/843] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:03:32 2022] DELETE /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:03:32.762227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:32.762837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:32.769229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.769681 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.770453 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:32.770893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:32.895532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:32.902769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-33d9b3b1-1fb8-44dd-8942-82223483dac3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1508 microversion: 2.1 time: 0.144383 May 11 19:03:32.903347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 415/844] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:32 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:33.540654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:33.541353 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:33.547896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:33.548343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:33.549102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:33.549534 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:33.679014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:33.686401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-85220224-cfb6-493e-9d49-59e7a4f13c13 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.149912 May 11 19:03:33.686990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 430/845] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:33 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:33.920154 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:33.920771 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:33.927619 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:33.928068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:33.928833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:33.929269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:34.063337 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:34.070892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-93a1aafc-10b1-4e2c-bec9-60b6bd766f83 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1508 microversion: 2.1 time: 0.154573 May 11 19:03:34.071486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 416/846] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:33 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:34.705751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:34.706359 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:34.712469 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:34.712916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:34.713776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:34.714215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:34.881330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:34.888677 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4a2b1c61-5715-4bb9-aa5a-b75c9c0fecf1 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.187676 May 11 19:03:34.889245 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 431/847] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:34 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:35.087711 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:35.088223 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:35.095229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:35.095703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:35.096464 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:35.096899 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:35.230363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:35.237636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-964d7ef6-ef2b-4777-a2e2-a3e7407127f3 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1508 microversion: 2.1 time: 0.153838 May 11 19:03:35.238202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 417/848] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:35 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:35.612610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-c4ab8ce9-8729-4bce-8a57-4699b9293c0b req-7f06d66c-1397-4aeb-a8b1-fa34994d3963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b93674-b607-42d9-bd2d-9abdce312e40", "name": "network-vif-deleted", "tag": "dd66c0eb-ac6a-4a7c-86bb-71dd9be5ff56"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:35.623749 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-c4ab8ce9-8729-4bce-8a57-4699b9293c0b req-7f06d66c-1397-4aeb-a8b1-fa34994d3963 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:35.625207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-c4ab8ce9-8729-4bce-8a57-4699b9293c0b req-7f06d66c-1397-4aeb-a8b1-fa34994d3963 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:35.638571 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-c4ab8ce9-8729-4bce-8a57-4699b9293c0b req-7f06d66c-1397-4aeb-a8b1-fa34994d3963 service nova] Creating event network-vif-deleted:dd66c0eb-ac6a-4a7c-86bb-71dd9be5ff56 for instance 54b93674-b607-42d9-bd2d-9abdce312e40 on hv-cinder-75510 May 11 19:03:35.644858 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-c4ab8ce9-8729-4bce-8a57-4699b9293c0b req-7f06d66c-1397-4aeb-a8b1-fa34994d3963 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037593 May 11 19:03:35.645564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 432/849] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:35.905817 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:35.906534 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:35.913588 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:35.914050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:35.914834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:35.915275 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.053359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:36.060819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-95d0dd3d-4843-424d-ae00-ebd3d11a0dd4 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.159023 May 11 19:03:36.061389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 418/850] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:35 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:36.255234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:36.256010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:36.262359 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.263171 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.264289 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.264731 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.299954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.300406 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.301690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'fault' on Instance uuid 54b93674-b607-42d9-bd2d-9abdce312e40 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:36.346939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:36.354254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-29dda394-d5aa-4320-b4e3-2eaa32e36b91 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 200 len: 1312 microversion: 2.1 time: 0.103638 May 11 19:03:36.354810 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 433/851] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:36 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:36.735165 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57719726-970c-4a2e-a29c-d9aef0fea6ac"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:36.736321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:36.742593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.743045 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.743914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.744353 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.821818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Invalid volume: volume 57719726-970c-4a2e-a29c-d9aef0fea6ac is already attached to instances: 98ab7e74-4252-4c1c-93c0-321e87317c2e May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: POST /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments HTTP/1.1 May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 74 May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:03:36.823566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {"volumeAttachment": {"volumeId": "57719726-970c-4a2e-a29c-d9aef0fea6ac"}} May 11 19:03:36.825115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Invalid volume: volume 57719726-970c-4a2e-a29c-d9aef0fea6ac is already attached to instances: 98ab7e74-4252-4c1c-93c0-321e87317c2e May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'server_id': '98ab7e74-4252-4c1c-93c0-321e87317c2e', 'body': {'volumeAttachment': {'volumeId': '57719726-970c-4a2e-a29c-d9aef0fea6ac'}}} May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 57719726-970c-4a2e-a29c-d9aef0fea6ac is already attached to instances: 98ab7e74-4252-4c1c-93c0-321e87317c2e May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:36.826782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 57719726-970c-4a2e-a29c-d9aef0fea6ac is already attached to instances: 98ab7e74-4252-4c1c-93c0-321e87317c2e May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:36.828112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 57719726-970c-4a2e-a29c-d9aef0fea6ac is already attached to instances: 98ab7e74-4252-4c1c-93c0-321e87317c2e May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 400 to user: Invalid volume: volume 57719726-970c-4a2e-a29c-d9aef0fea6ac is already attached to instances: 98ab7e74-4252-4c1c-93c0-321e87317c2e {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-52753873-2c23-42b6-bdf5-6c8387f12040 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094369 May 11 19:03:36.829404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 419/852] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:03:36 2022] POST /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 19:03:36.882913 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:36.883441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:36.889191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.889646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.890416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:36.890856 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:36.968801 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lazy-loading 'services' on Instance uuid 98ab7e74-4252-4c1c-93c0-321e87317c2e {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:37.037451 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-afafd738-c007-4623-80d7-cdcab0ccf69b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments/57719726-970c-4a2e-a29c-d9aef0fea6ac" status: 202 len: 0 microversion: 2.1 time: 0.158176 May 11 19:03:37.038016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 434/853] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:03:36 2022] DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments/57719726-970c-4a2e-a29c-d9aef0fea6ac => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:37.046971 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:37.047973 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:37.054618 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.055088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.055891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.056388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.080268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:37.081062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:37.087194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.087370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6b133cb3-2018-4181-9155-69e2ae6bf087 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 May 11 19:03:37.087684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.087830 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 420/854] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:37 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:37.088464 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.088902 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.217587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:37.228077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-95154efe-b5b3-4c70-abf6-d2dede9c05ca tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.153747 May 11 19:03:37.228651 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 435/855] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:37 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:37.371158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:37.371707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: 54b93674-b607-42d9-bd2d-9abdce312e40] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:37.377625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.378075 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.378833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.379266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.392583 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] HTTP exception thrown: Instance 54b93674-b607-42d9-bd2d-9abdce312e40 could not be found. May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Request method failure captured: May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 HTTP/1.1 May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcsGGgWD9RNIHOPFUGdk8L2sOaCDc95Cdt0R2wHKl6Mw__4fqbGLhBEyF7868GENhFJXpC-ojSKj0f9z4-_Y73kLdHW7e8kOxxf-A0GFvFoB1Vk5VAu4stie31mIIy8PVl6l_1mY9RqmllOzp57kIfaMLiQSH30_t9aedi7q3UCoqc May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:03:37.394058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d22bd9d4df840c1af348b3f257593a3", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: c9d83909ea2943f5834778a2a9aa1485 May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 54b93674-b607-42d9-bd2d-9abdce312e40 could not be found. May 11 19:03:37.395557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '54b93674-b607-42d9-bd2d-9abdce312e40'} May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b93674-b607-42d9-bd2d-9abdce312e40 could not be found. May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:37.396348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b93674-b607-42d9-bd2d-9abdce312e40 could not be found. May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b93674-b607-42d9-bd2d-9abdce312e40 could not be found. May 11 19:03:37.397666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:37.398819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Returning 404 to user: Instance 54b93674-b607-42d9-bd2d-9abdce312e40 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:37.398819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0840cbc7-f6bc-4135-8abe-310da94e0962 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40" status: 404 len: 111 microversion: 2.1 time: 0.028265 May 11 19:03:37.398819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 421/856] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:37 2022] GET /compute/v2.1/servers/54b93674-b607-42d9-bd2d-9abdce312e40 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:37.403894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:37.404419 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:37.411275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.411756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.412509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.412938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.436710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:03:37.508833 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bf4d1f34-0ecf-4308-94cd-34114beed7ed tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 204 len: 0 microversion: 2.1 time: 0.108396 May 11 19:03:37.509487 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 436/857] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:03:37 2022] DELETE /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:03:37.517875 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:37.518482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:37.524455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.524906 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.525677 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:37.526122 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:37.654263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:37.662042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-94cae664-5584-4521-bc4b-4af7674a5f88 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.148481 May 11 19:03:37.662593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 422/858] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:37 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:38.099893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:38.101078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:38.107035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:38.107518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:38.108283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:38.109296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:38.138708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-60d1131b-b9a3-42e9-90e7-ffc3a5b699bd tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 May 11 19:03:38.139308 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 437/859] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:38 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:38.247269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:38.247901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:38.254293 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:38.254742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:38.255546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:38.255980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:38.382599 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:38.390397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-76f977d5-451b-428b-b0d8-20306af38cd6 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.146524 May 11 19:03:38.390956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 423/860] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:38 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:38.678805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:38.679467 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:38.685765 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:38.686205 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:38.687489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:38.687919 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:38.816467 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:38.823871 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7ad7a7c9-36cc-40c9-b5ac-dcfeded18dcd tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.148759 May 11 19:03:38.824488 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 438/861] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:38 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:39.150096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:39.150951 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:39.156870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:39.157317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:39.158084 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:39.158595 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:39.187634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a6b8813d-211c-49d0-8c8b-470cb098018c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 May 11 19:03:39.188176 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 424/862] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:39 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:39.407870 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:39.408424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:39.414567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:39.415018 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:39.415816 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:39.416254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:39.701682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:39.709884 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f717a716-272a-4f85-9055-ee8660da6352 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.306470 May 11 19:03:39.710454 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 439/863] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:39 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:39.841023 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:39.841790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:39.848644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:39.849090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:39.849839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:39.850268 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:39.980354 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:39.988464 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-25e10893-9079-4d38-ac91-2d06173f0441 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1522 microversion: 2.1 time: 0.151249 May 11 19:03:39.989036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 425/864] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:39 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:40.199399 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:40.200370 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:40.206280 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:40.206730 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:40.207535 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:40.208287 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:40.237109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-74ddfb16-9cc2-43da-a354-bdfa66528924 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 May 11 19:03:40.237583 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 440/865] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:40 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:40.727678 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:40.728299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:40.734552 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:40.734726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:40.735480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:40.735927 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:40.970589 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-4033aa40-6612-4813-980a-193e01bc6368 req-196675f7-4944-43fc-8e56-004047a15c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57bf0b3-ec26-4008-9534-60b21519c99c", "name": "network-vif-deleted", "tag": "6b468130-64ed-447f-acd8-06ef735243a3"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:40.982015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4033aa40-6612-4813-980a-193e01bc6368 req-196675f7-4944-43fc-8e56-004047a15c80 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:40.982837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4033aa40-6612-4813-980a-193e01bc6368 req-196675f7-4944-43fc-8e56-004047a15c80 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:40.996389 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-4033aa40-6612-4813-980a-193e01bc6368 req-196675f7-4944-43fc-8e56-004047a15c80 service nova] Creating event network-vif-deleted:6b468130-64ed-447f-acd8-06ef735243a3 for instance b57bf0b3-ec26-4008-9534-60b21519c99c on hv-cinder-75510 May 11 19:03:41.002531 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-4033aa40-6612-4813-980a-193e01bc6368 req-196675f7-4944-43fc-8e56-004047a15c80 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035922 May 11 19:03:41.003116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 441/866] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:03:41.008401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:41.009097 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:41.016645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.017128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.017913 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.018350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.084421 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:41.095209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7d0ad779-614d-436d-bda6-d206e460f651 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1480 microversion: 2.1 time: 0.090683 May 11 19:03:41.095823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 442/867] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:41 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1480 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:41.211478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:41.219801 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7ab94250-35b0-472c-9515-fbfd8eff27e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.495947 May 11 19:03:41.220381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 426/868] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:40 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:41.248320 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:41.249294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:41.255594 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.256085 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.256807 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.257246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.293615 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-181e5604-b277-451e-b9eb-11cab411d641 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049214 May 11 19:03:41.294178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 443/869] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:41 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:03:41.359443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:41.360218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:41.366363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.366805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.367613 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.368042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.394346 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:03:41.472731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-135db70f-e0f6-4c11-ac78-ee1155e8cc49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 204 len: 0 microversion: 2.1 time: 0.116952 May 11 19:03:41.473313 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 427/870] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:03:41 2022] DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:03:41.481701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:41.482313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:41.488690 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.489134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.489887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:41.490316 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:41.624344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:41.631773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3e65968b-91a0-44fa-9b0c-d9ccc1a762bb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1683 microversion: 2.1 time: 0.153996 May 11 19:03:41.632439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 444/871] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:41 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:42.112790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:42.113517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:42.119863 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.120316 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.121080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.121521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.152983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.153436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.153882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'fault' on Instance uuid b57bf0b3-ec26-4008-9534-60b21519c99c {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:42.197503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:42.205463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6243a940-7292-46bb-b2dd-c81baf0ce376 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1312 microversion: 2.1 time: 0.096874 May 11 19:03:42.206032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 428/872] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:42 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:42.236925 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:42.237514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:42.243869 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.244316 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.245074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.245506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.369647 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:42.377490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-89e9f33a-3e52-477b-8962-608540d557ba tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.144429 May 11 19:03:42.378046 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 445/873] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:42 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:42.649624 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:42.650223 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:42.656141 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.656582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.657331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:42.657769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:42.785379 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:42.792653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-04796aa5-e50e-4aaf-9713-7830d1f9754e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1683 microversion: 2.1 time: 0.146832 May 11 19:03:42.793210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 429/874] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:42 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:43.221920 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:43.222662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:43.228491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.228949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.229724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.230159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.262074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.262738 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.263128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lazy-loading 'fault' on Instance uuid b57bf0b3-ec26-4008-9534-60b21519c99c {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:43.311322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d83909ea2943f5834778a2a9aa1485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22bd9d4df840c1af348b3f257593a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:43.324314 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ffa7ae28-770c-4f5a-955a-8b5d95057c4b tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 200 len: 1312 microversion: 2.1 time: 0.106202 May 11 19:03:43.324892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 446/875] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:43 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:43.394441 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:43.395134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:43.406255 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:43.406581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.407028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.407595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:43.407998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.408531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.417067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.417511 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.418280 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.418715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.448557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-01b41612-8dd1-4d7f-806c-fe0983fd42fe tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050067 May 11 19:03:43.449110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 447/876] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:03:43 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 19:03:43.505257 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:43.505748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:43.511489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.511936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.512696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.513126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.537803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:03:43.545629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:43.554611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c40dff30-6326-40a5-8d68-a1239d4876e5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.164579 May 11 19:03:43.566050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 430/877] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:43 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:43.630383 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0ba8aa95-f46f-4e36-beb0-7bec021aee3a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 204 len: 0 microversion: 2.1 time: 0.128938 May 11 19:03:43.630953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 448/878] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:03:43 2022] DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 19:03:43.639325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:43.639959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:43.646054 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.646538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.647325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.648003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.809573 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:43.810778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:43.811622 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:43.817421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-612188f9-d3c2-4d68-8787-114262230918 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1672 microversion: 2.1 time: 0.181938 May 11 19:03:43.817574 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.817869 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.818242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 431/879] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:43 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:43.818629 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:43.819346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:43.943061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:43.950579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-23ff61b1-c19d-40d7-b131-bf80654aa65e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1683 microversion: 2.1 time: 0.144226 May 11 19:03:43.951143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 449/880] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:43 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:44.341344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:44.341950 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] [instance: b57bf0b3-ec26-4008-9534-60b21519c99c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:44.348483 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:44.348933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:44.349697 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:44.350133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:44.363250 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] HTTP exception thrown: Instance b57bf0b3-ec26-4008-9534-60b21519c99c could not be found. May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Request method failure captured: May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c HTTP/1.1 May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcsGGgWD9RNIHOPFUGdk8L2sOaCDc95Cdt0R2wHKl6Mw__4fqbGLhBEyF7868GENhFJXpC-ojSKj0f9z4-_Y73kLdHW7e8kOxxf-A0GFvFoB1Vk5VAu4stie31mIIy8PVl6l_1mY9RqmllOzp57kIfaMLiQSH30_t9aedi7q3UCoqc May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:03:44.364889 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d22bd9d4df840c1af348b3f257593a3", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d22bd9d4df840c1af348b3f257593a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 1d22bd9d4df840c1af348b3f257593a3 May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1600680142 May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: c9d83909ea2943f5834778a2a9aa1485 May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1600680142-project May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance b57bf0b3-ec26-4008-9534-60b21519c99c could not be found. May 11 19:03:44.366726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'b57bf0b3-ec26-4008-9534-60b21519c99c'} May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57bf0b3-ec26-4008-9534-60b21519c99c could not be found. May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:44.367596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57bf0b3-ec26-4008-9534-60b21519c99c could not be found. May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57bf0b3-ec26-4008-9534-60b21519c99c could not be found. May 11 19:03:44.369006 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:44.370279 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] Returning 404 to user: Instance b57bf0b3-ec26-4008-9534-60b21519c99c could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:44.370279 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b32cc37a-9be6-470f-9b23-7b11d5f2ae81 tempest-ServerRescueNegativeTestJSON-1600680142 tempest-ServerRescueNegativeTestJSON-1600680142-project] 10.222.0.93 "GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c" status: 404 len: 111 microversion: 2.1 time: 0.028782 May 11 19:03:44.370279 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 432/881] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:44 2022] GET /compute/v2.1/servers/b57bf0b3-ec26-4008-9534-60b21519c99c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:44.572971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:44.573577 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:44.580510 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:44.580958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:44.581724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:44.582161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:44.834558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:44.835641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:44.842677 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:44.843247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:44.844143 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:44.844650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:45.034517 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:45.042493 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d367cff6-9673-405b-99ab-13e218afab3d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1672 microversion: 2.1 time: 0.211744 May 11 19:03:45.052516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 433/882] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:44 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:45.052516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:45.052516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:45.057088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:45.057538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:45.058318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:45.058754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:45.152737 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:45.160620 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-bd747fe9-dd39-4512-b297-0b753cb1d7a5 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.591752 May 11 19:03:45.161517 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 450/883] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:44 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:45.404107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:45.414557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e35afd08-faa4-4bb4-b406-6f90c65d2c26 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1683 microversion: 2.1 time: 0.369862 May 11 19:03:45.415320 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 434/884] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:45 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1683 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:46.060711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:46.062349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:46.068897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.071021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.072186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.072643 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.156294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:46.166767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-62a533b9-94f1-446c-bc97-2dfe3def1522 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1604 microversion: 2.1 time: 0.110139 May 11 19:03:46.167984 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 451/885] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:46 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1604 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:46.182630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:46.183245 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:46.191154 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.191484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.192710 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.193158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.421102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-4a26a9eb-896c-4fc9-9c18-75daf9c05b8d req-fd474453-9d87-48e2-bada-8f4a07ea160b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8", "name": "network-vif-deleted", "tag": "e8360471-a390-41bb-94e5-cfb5a5d2040d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:46.454102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4a26a9eb-896c-4fc9-9c18-75daf9c05b8d req-fd474453-9d87-48e2-bada-8f4a07ea160b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.454851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4a26a9eb-896c-4fc9-9c18-75daf9c05b8d req-fd474453-9d87-48e2-bada-8f4a07ea160b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.468592 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:46.479819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a3449e76-cb0e-4035-9cec-54731af71e45 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.300467 May 11 19:03:46.503531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 435/886] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:46 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:46.511053 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-4a26a9eb-896c-4fc9-9c18-75daf9c05b8d req-fd474453-9d87-48e2-bada-8f4a07ea160b service nova] Creating event network-vif-deleted:e8360471-a390-41bb-94e5-cfb5a5d2040d for instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 on hv-cinder-75510 May 11 19:03:46.517181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:46.519806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:46.528228 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-4a26a9eb-896c-4fc9-9c18-75daf9c05b8d req-fd474453-9d87-48e2-bada-8f4a07ea160b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328137 May 11 19:03:46.530399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.531346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 452/887] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:46.533489 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.536562 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.540227 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:46.540901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.544607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:46.563908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.565420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.569598 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.570375 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.609325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e49d8fcc-48bd-4416-b3d2-b4145d41645e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/ips" status: 200 len: 151 microversion: 2.20 time: 0.103711 May 11 19:03:46.610289 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 436/888] 10.222.0.93 () {60 vars in 1288 bytes} [Wed May 11 19:03:46 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 19:03:46.620890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-c47b39b3-105d-4fc4-9bff-4e9b0a931ccd req-ee2751ff-5814-4af4-a02f-444087e7d556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ab7e74-4252-4c1c-93c0-321e87317c2e", "name": "network-vif-deleted", "tag": "15caf110-6241-4b8c-b213-436076569974"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:46.642649 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-c47b39b3-105d-4fc4-9bff-4e9b0a931ccd req-ee2751ff-5814-4af4-a02f-444087e7d556 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:46.644589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-c47b39b3-105d-4fc4-9bff-4e9b0a931ccd req-ee2751ff-5814-4af4-a02f-444087e7d556 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:46.659750 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-c47b39b3-105d-4fc4-9bff-4e9b0a931ccd req-ee2751ff-5814-4af4-a02f-444087e7d556 service nova] Creating event network-vif-deleted:15caf110-6241-4b8c-b213-436076569974 for instance 98ab7e74-4252-4c1c-93c0-321e87317c2e on hv-cinder-75510 May 11 19:03:46.666415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-c47b39b3-105d-4fc4-9bff-4e9b0a931ccd req-ee2751ff-5814-4af4-a02f-444087e7d556 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053943 May 11 19:03:46.668347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 437/889] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:46.744653 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:46.755634 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d8069ae8-05ae-4ddd-b94a-860347986c63 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1615 microversion: 2.1 time: 0.220252 May 11 19:03:46.756941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 453/890] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:46 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1615 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:47.188603 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:47.190931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:47.200007 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.200734 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.201728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.205025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.287661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:47.297383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d5eebcde-4a2b-47b3-a706-ca925e2ce08f tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1322 microversion: 2.1 time: 0.115294 May 11 19:03:47.299439 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 438/891] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:47 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1322 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:47.503611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:47.505175 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:47.513499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.514146 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.516260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.516969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.773872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:47.774941 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:47.785128 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.785836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.786779 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.790147 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.842046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:47.842501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:47.844995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lazy-loading 'fault' on Instance uuid 98ab7e74-4252-4c1c-93c0-321e87317c2e {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:47.902843 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:47.910894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b7ac88af-196b-41a7-b4b4-e26219f72f5d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 200 len: 1332 microversion: 2.1 time: 0.140865 May 11 19:03:47.911818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 439/892] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:47 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:47.929563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:47.941374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fcc714fc-69ce-4d82-b348-4278d1e4e3b0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.442843 May 11 19:03:47.942910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 454/893] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:47 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:48.314782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:48.315534 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:48.337977 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.338440 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.339233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.339705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.424523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.425207 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.425663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lazy-loading 'fault' on Instance uuid 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:48.470745 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:48.479514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5b786418-d6be-41c9-949b-4d0bb12117e1 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 200 len: 1327 microversion: 2.1 time: 0.169252 May 11 19:03:48.480322 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 440/894] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:48 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:48.623432 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:48.626255 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:48.633342 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.633797 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.634574 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.635008 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.660817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lazy-loading 'flavor' on Instance uuid fe7eaafe-a747-46df-a1f1-c43cbe88e720 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:03:48.929983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:48.930592 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:48.937687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.938388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.939344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.939768 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.957519 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e HTTP/1.1 May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:03:48.959175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:03:48.960476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '98ab7e74-4252-4c1c-93c0-321e87317c2e'} May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:48.961714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:03:48.962931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:03:48.964031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:48.964031 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1aae68ef-7d0b-4876-93e1-ee379168c259 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 404 len: 111 microversion: 2.1 time: 0.034737 May 11 19:03:48.966301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 441/895] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:48 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:48.971625 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:48.972227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:48.982855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.983910 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:48.984725 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:48.985161 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.017635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-51303ad6-c757-4193-84b0-b3992f67f9f5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/action" status: 202 len: 0 microversion: 2.20 time: 0.397900 May 11 19:03:49.018268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 455/896] 10.222.0.93 () {62 vars in 1318 bytes} [Wed May 11 19:03:48 2022] POST /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 19:03:49.023665 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0ac3a67a-0d35-4776-875a-ccbf399de975 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '.version_select at 0x7fa7907fe3a0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:49.044364 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0ac3a67a-0d35-4776-875a-ccbf399de975 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355410743" status: 202 len: 0 microversion: 2.1 time: 0.024650 May 11 19:03:49.045105 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 456/897] 10.222.0.93 () {58 vars in 1220 bytes} [Wed May 11 19:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355410743 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:49.050045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:49.050899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:49.058188 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.058681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.059508 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.059947 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.136419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:49.145688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4d88dfc5-76fb-4c61-9be2-7bf7eb501215 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1568 microversion: 2.1 time: 0.177671 May 11 19:03:49.146273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 442/898] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:48 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:49.162761 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:49.163567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:49.169840 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.169985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.170874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.171698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.356802 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:49.370913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1b442065-fcae-474d-815d-21bec71325af tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "POST /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b/action" status: 202 len: 0 microversion: 2.1 time: 0.212346 May 11 19:03:49.375507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 443/899] 10.222.0.93 () {60 vars in 1277 bytes} [Wed May 11 19:03:49 2022] POST /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:03:49.385255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:49.386150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:49.393893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:49.399189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:49.404150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.404340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-763480b9-256c-4a21-8248-783c6367db5f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.355421 May 11 19:03:49.416304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 457/900] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:49 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:49.416528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.416528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.416528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.497196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:49.497758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:49.505772 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.506239 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.507033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:49.511866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:49.527195 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] HTTP exception thrown: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Request method failure captured: May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 HTTP/1.1 May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc3Yfhe0AXgI6ErlqsuDXPIkM7LBYPVG1rTelMv_GjO-DZ446j51Rq8MfL54ouYIOmu-nCgv84NB3a9xm4eKWvy1gh6FwMDBrhfbBOAg70GrrDXqIDkKkH6n_WfgmRuqXQRVTkuFIfCzQOL2Yle9Y9T35e4oblJ4-sUzX_WU2r4dmU May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:03:49.529584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_35ad10e77d194397ba6a84cf39758839", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeTestJSON-1854070251 May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f8edf1e5f81c4e81b346c82cb48a47f6 May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:03:49.530990 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8'} May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:03:49.531809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:03:49.533058 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:03:49.534330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Returning 404 to user: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:03:49.534330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0c29458a-957a-4e2f-9ddc-231a195a56f3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 404 len: 111 microversion: 2.1 time: 0.038583 May 11 19:03:49.536189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 458/901] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:49 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:03:49.541122 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fb3a3348-14e1-4b39-9d09-e100fb2f233c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '.version_select at 0x7fa7906d0d30>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:49.576671 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fb3a3348-14e1-4b39-9d09-e100fb2f233c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905375014" status: 202 len: 0 microversion: 2.1 time: 0.039336 May 11 19:03:49.583159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 459/902] 10.222.0.93 () {58 vars in 1217 bytes} [Wed May 11 19:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905375014 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:03:49.826470 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:49.834764 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a0a5fc8f-2e58-4d32-8ab0-f502c73de9ce tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1516 microversion: 2.1 time: 0.454960 May 11 19:03:49.835381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 444/903] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:49 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:50.268779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4fbff4fc-e18a-4380-864e-a6c337be209d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: .version_select at 0x7fa7907e8b80>, body: {"keypair": {"name": "tempest-keypair-2079985342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBd2BYkxz9dckm+kT6o82o2t946pm95cUzWaU03REuSdeb3Foamn/r9UIbdYjfYReBBntwVXTXrbuK18KsilHz+T8+5n0FlHHUxLLQzTp1NGjjhiq5Y9SMKgpQyaHEmo/A=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:50.284773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-4fbff4fc-e18a-4380-864e-a6c337be209d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:03:50.289069 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-4fbff4fc-e18a-4380-864e-a6c337be209d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:03:50.315329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4fbff4fc-e18a-4380-864e-a6c337be209d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051371 May 11 19:03:50.316270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 460/904] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 19:03:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:50.426551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:50.428128 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:50.437936 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:50.438781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:50.439977 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:50.440621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:50.602860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:50.613492 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:50.615687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:50.617224 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1955d2bb-be06-4918-a1fc-190e94d497f0 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.197419 May 11 19:03:50.617801 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 445/905] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:50 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:50.813338 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0a5fef9a-7bed-496a-b1c9-5fc23589677d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: .version_select at 0x7fa7907e89d0>, body: {"keypair": {"name": "tempest-keypair-447422281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmhFHl0ttm4c4d6wSZm+Z0jeIo7uy7uvkC5N/Ppeq3ayBsun99Cp1QBfmaBiZmy4tHX2+f1mCT4a+au8Qr3IR0dcyNMaT6HzHmZLcyuht24h29wfKZmtYO2S2coYcjfwQ=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:50.829075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-0a5fef9a-7bed-496a-b1c9-5fc23589677d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for project 35ad10e77d194397ba6a84cf39758839. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:03:50.833617 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-0a5fef9a-7bed-496a-b1c9-5fc23589677d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for user f8edf1e5f81c4e81b346c82cb48a47f6 and project 35ad10e77d194397ba6a84cf39758839. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:03:50.853536 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:50.854276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:50.864776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0a5fef9a-7bed-496a-b1c9-5fc23589677d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055919 May 11 19:03:50.871750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 461/906] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 19:03:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:50.880751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:50.881229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:50.883446 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:50.885335 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:51.315694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-d38ee206-bb62-4cb0-9913-31bb46b82447 req-8ac832e5-a63c-4351-aad5-10acf79b2b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "name": "network-vif-unplugged", "status": "completed", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:51.326209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-d38ee206-bb62-4cb0-9913-31bb46b82447 req-8ac832e5-a63c-4351-aad5-10acf79b2b29 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:51.327612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-d38ee206-bb62-4cb0-9913-31bb46b82447 req-8ac832e5-a63c-4351-aad5-10acf79b2b29 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:51.340851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.compute.server_external_events [req-d38ee206-bb62-4cb0-9913-31bb46b82447 req-8ac832e5-a63c-4351-aad5-10acf79b2b29 service nova] Unable to find a host for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b. Dropping event network-vif-unplugged {{(pid=117096) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 19:03:51.342144 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-d38ee206-bb62-4cb0-9913-31bb46b82447 req-8ac832e5-a63c-4351-aad5-10acf79b2b29 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.240675 May 11 19:03:51.343141 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 462/907] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 242 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 11 19:03:51.419339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:51.433974 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ef1751a5-c28c-4f0a-8ee5-b6e9c3b27a8e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1518 microversion: 2.1 time: 0.584985 May 11 19:03:51.440518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 446/908] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:50 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:51.636066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:51.636861 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:51.647953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:51.650017 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:51.651106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:51.651832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:51.828115 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:51.836953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:51.839082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:51.840516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ef694ab9-334b-4a5c-93fb-b6a784024abb tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.208654 May 11 19:03:51.841260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 463/909] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:51 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:52.458852 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:52.460120 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:52.468474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:52.469152 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:52.470134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:52.470559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:52.736680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1667027319", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd681a56-5e31-47e5-a902-5d88ec1edff4"}], "security_groups": [{"name": "tempest-securitygroup--821299542"}], "key_name": "tempest-keypair-447422281", "user_data": "}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:52.761793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:52.772525 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3cd9cba0-cd77-4e17-8f42-a1fa825b5ff7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.317409 May 11 19:03:52.773255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 447/910] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:52 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:52.859005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:52.859641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:52.867415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:52.868048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:52.872277 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:52.872726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:52.875402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] validate_networks() for [('bd681a56-5e31-47e5-a902-5d88ec1edff4', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:03:53.113965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:53.124309 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:53.126286 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:53.127961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7e9c05e2-5d55-4fec-9fd0-6d313acd1a20 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.272842 May 11 19:03:53.138819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 448/911] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:52 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:03:53.145582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1440041027", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6834a0-4dee-47c7-b460-ae66831e3d5b"}], "security_groups": [{"name": "tempest-securitygroup--824343359"}], "key_name": "tempest-keypair-2079985342", "user_data": "}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:53.253980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] validate_networks() for [('6b6834a0-4dee-47c7-b460-ae66831e3d5b', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:03:53.414832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:03:53.415263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:03:53.416010 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:03:53.416615 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:03:53.417099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:03:53.428340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:53.429099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:53.430181 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:53.430837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:53.454352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for project 35ad10e77d194397ba6a84cf39758839. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:03:53.459374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Getting quotas for user f8edf1e5f81c4e81b346c82cb48a47f6 and project 35ad10e77d194397ba6a84cf39758839. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:03:53.473584 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:03:53.476078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:03:53.524728 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-49873d05-ae0d-412f-8825-896825311479 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.793592 May 11 19:03:53.531812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 464/912] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:03:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:03:53.537654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e18bb0a9-4ce7-42b4-a566-acd5aa2cb6a0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:53.538356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e18bb0a9-4ce7-42b4-a566-acd5aa2cb6a0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:53.599014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e18bb0a9-4ce7-42b4-a566-acd5aa2cb6a0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:53.606552 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e18bb0a9-4ce7-42b4-a566-acd5aa2cb6a0 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1237 microversion: 2.1 time: 0.073308 May 11 19:03:53.607189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 465/913] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:53 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:53.743862 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:03:53.744317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:03:53.744854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:03:53.745473 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:03:53.746000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:03:53.757311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:53.757833 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:53.759082 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:53.759679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:53.786185 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:03:53.789995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:53.790482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:53.793403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Getting quotas for user f1f10686b4814794aadc34ec6194cc6b and project 286035250ee843e696e2422db9319f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:03:53.798407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:53.798859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:53.799672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:53.800229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:53.810183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:03:53.812582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:03:53.875719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6e23f335-fd69-436a-887c-efe892cc9e49 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734780 May 11 19:03:53.876784 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 449/914] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:03:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:03:53.901397 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5860cfe4-c1e3-441c-b68c-f9290f216610 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:53.904607 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5860cfe4-c1e3-441c-b68c-f9290f216610 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:53.981914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5860cfe4-c1e3-441c-b68c-f9290f216610 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:53.992530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5860cfe4-c1e3-441c-b68c-f9290f216610 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1242 microversion: 2.1 time: 0.100947 May 11 19:03:54.002042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 450/915] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:53 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:54.003178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:54.012165 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-81104e5d-4efc-4913-8a73-88cb82d94f00 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.226098 May 11 19:03:54.013618 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 466/916] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:53 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:54.146791 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:54.147431 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:54.154436 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:54.155139 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:54.156128 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:54.156902 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:54.331022 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:54.339980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:54.341497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:54.342696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e0f4cade-1419-47b1-8bf3-8d4f5cc2e024 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.199842 May 11 19:03:54.343321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 451/917] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:54 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:03:54.623573 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:54.624709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:54.630786 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:54.631238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:54.632586 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:54.632586 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:54.702244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:54.709441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c19dd335-6b23-4c57-b74d-daf4b92f7dcd tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1289 microversion: 2.1 time: 0.089859 May 11 19:03:54.710005 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 467/918] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:54 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:55.009311 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:55.009948 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:55.016813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.017269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.018036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.018474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.029766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:55.031027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:55.037708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.038162 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.039157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.039634 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.092018 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:55.102980 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-baed785c-0e9c-476a-b0d3-a395b693d5ff tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1294 microversion: 2.1 time: 0.097347 May 11 19:03:55.104163 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 452/919] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:55 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:55.211883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:55.220136 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-37600179-e94f-4d2e-9232-6489af5423e7 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.194242 May 11 19:03:55.220701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 468/920] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:55 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:55.360766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:55.361846 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:55.372701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.373456 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.374972 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.378221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.647684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:55.671330 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:55.674091 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:55.675682 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-feeaa966-8e5d-40de-bd58-7561c67eb459 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.318964 May 11 19:03:55.676811 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 453/921] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:55 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:55.725975 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:55.726587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:55.733680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.734404 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.735434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:55.736115 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:55.825301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:55.832828 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ffc36d61-319c-42a7-9448-7d43bfa6c221 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1295 microversion: 2.1 time: 0.110713 May 11 19:03:55.843892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 469/922] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:55 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:56.121111 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:56.121759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:56.132761 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.138405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.140014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.140631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.238708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:56.239453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:56.248394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.249061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.249847 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.250346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.471407 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:56.480272 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-02576734-64a7-44bf-aae2-a71cffd1df66 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.359957 May 11 19:03:56.480890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 454/923] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:56 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:56.665717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:56.674283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-80deb7fe-1fbf-4caf-9ef7-20a537b6f5b2 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.440456 May 11 19:03:56.675131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 470/924] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:56 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:56.695437 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:56.697112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:56.728205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.729808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.731789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.734352 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.851339 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:56.852114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:56.859345 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.859814 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.860610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:56.861053 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:56.941856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:56.954276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:56.959892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:56.961772 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f7e4f897-45bf-4233-8ca5-dc5c4a8a6998 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.272316 May 11 19:03:56.963169 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 455/925] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:56 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:57.169901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:57.188667 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-dd01c8ee-36a3-4220-934c-73099d7797d9 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.341687 May 11 19:03:57.192441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 471/926] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:56 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:57.223958 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-0b148b64-dd88-4b98-970a-776a7ce0252f req-d975dcff-573e-4c5a-aabb-44327eeae58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c", "tag": "92885fc5-1cdd-43af-99e2-42131f03dcaf"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:57.235919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-0b148b64-dd88-4b98-970a-776a7ce0252f req-d975dcff-573e-4c5a-aabb-44327eeae58c service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:57.236629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-0b148b64-dd88-4b98-970a-776a7ce0252f req-d975dcff-573e-4c5a-aabb-44327eeae58c service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:57.256269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-0b148b64-dd88-4b98-970a-776a7ce0252f req-d975dcff-573e-4c5a-aabb-44327eeae58c service nova] Creating event network-changed:92885fc5-1cdd-43af-99e2-42131f03dcaf for instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c on hv-cinder-75510 May 11 19:03:57.261885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-0b148b64-dd88-4b98-970a-776a7ce0252f req-d975dcff-573e-4c5a-aabb-44327eeae58c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042236 May 11 19:03:57.263205 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 456/927] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:57.360406 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-dd2bf9bd-9ebd-4d3d-889a-ca78b9082998 req-17c183ba-9008-4b89-acd3-e4d14c94a023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1720b2d-be3b-4474-903d-326b5bc54244", "tag": "7731a148-77af-4830-adff-e06db2517e6e"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:03:57.415828 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-dd2bf9bd-9ebd-4d3d-889a-ca78b9082998 req-17c183ba-9008-4b89-acd3-e4d14c94a023 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:57.416329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-dd2bf9bd-9ebd-4d3d-889a-ca78b9082998 req-17c183ba-9008-4b89-acd3-e4d14c94a023 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:57.435226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-dd2bf9bd-9ebd-4d3d-889a-ca78b9082998 req-17c183ba-9008-4b89-acd3-e4d14c94a023 service nova] Creating event network-changed:7731a148-77af-4830-adff-e06db2517e6e for instance a1720b2d-be3b-4474-903d-326b5bc54244 on hv-cinder-75510 May 11 19:03:57.450244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-dd2bf9bd-9ebd-4d3d-889a-ca78b9082998 req-17c183ba-9008-4b89-acd3-e4d14c94a023 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094334 May 11 19:03:57.451116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 472/928] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:03:57.500455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:57.501120 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:57.507466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:57.507913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:57.509058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:57.509706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:57.696664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:57.697627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:57.704813 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:57.705323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:57.706107 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:57.706538 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:57.960930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:57.971063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-84f376b7-0d61-4779-96bf-cf1178bfacde tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.281871 May 11 19:03:57.981301 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 473/929] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:57 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:57.987520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:57.988983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:57.999213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:58.008387 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:58.010042 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c5ef9a86-dcdd-4c64-ace3-70c92b38368b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.514218 May 11 19:03:58.011385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:58.011835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 457/930] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:57 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:58.012864 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:58.013514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:58.158745 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:58.166995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:58.168533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:58.169707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-89571106-2cb9-45b5-95e0-4da5464c0c21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.187078 May 11 19:03:58.170358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 474/931] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:57 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:58.209195 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:58.209665 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:58.216107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:58.216645 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:58.218085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:58.218529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:58.352557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:58.360516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e5a7061b-17dd-446c-9580-2745c1d8a181 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.155309 May 11 19:03:58.361090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 458/932] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:58 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:58.988360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:58.990020 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:58.996182 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:58.996823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:58.997760 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:58.998196 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.028409 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:59.029040 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:59.035027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:59.035523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.036291 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:59.036735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.143445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:59.152190 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-df43255b-85b1-4727-8f83-c53e7f1bbc2d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.167212 May 11 19:03:59.152815 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 475/933] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:58 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:03:59.171231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:59.179166 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-56ccf542-6286-437b-8ec1-cc74b5e77508 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.154556 May 11 19:03:59.179813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 459/934] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:59 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:03:59.192049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:59.192879 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:59.199128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:59.199622 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.200460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:59.201134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.331558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:59.339798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:59.341380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:59.342800 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a667ad60-7760-4d88-ba68-41c9f4b58002 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.154859 May 11 19:03:59.343465 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 476/935] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:03:59 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:03:59.377523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:03:59.378135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:03:59.384414 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:59.384878 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.385651 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:03:59.386098 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:03:59.533698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:03:59.541124 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-abfcdf4d-fe23-40e0-b1de-fa7a33770219 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.167994 May 11 19:03:59.541785 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 460/936] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:03:59 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:00.169071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:00.169778 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:00.176075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.176520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.177276 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.177710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.196650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:00.197348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:00.204039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.204575 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.205366 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.205805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.305733 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:00.313847 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-18f9a221-b5cc-45cf-8f7a-a7e254520221 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.148727 May 11 19:04:00.314410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 477/937] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:00 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:00.335729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:00.343010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-37f85edb-9cb2-4222-a235-42c08fab883c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.150449 May 11 19:04:00.343608 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 461/938] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:00 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:00.360226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:00.360834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:00.366646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.367100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.367898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.368335 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.493529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:00.501894 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:00.503433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:00.504604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4cff3383-4743-4f9f-9d3f-9d6bcdf8c1cf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.148277 May 11 19:04:00.505164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 478/939] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:00 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:00.557748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:00.558355 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:00.565715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.566177 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.567611 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:00.568055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:00.760106 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:00.769129 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6e0055d3-71b1-404e-9b75-740a958f7cc8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.214012 May 11 19:04:00.769129 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 462/940] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:00 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:01.331434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:01.332595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:01.340756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.341445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.342394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.342982 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.362208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:01.362851 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:01.371439 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.371895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.372880 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.373447 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.498102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:01.512282 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e07b6a70-ddbd-466d-a028-192b506bfb6f tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.186104 May 11 19:04:01.513214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 479/941] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:01 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:01.520738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:01.528992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:01.529599 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:01.535847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-994a609f-d92c-4f70-9a01-41b6884c8e90 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.179892 May 11 19:04:01.536434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 463/942] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:01 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:01.541882 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.542333 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.543193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.543558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.682073 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:01.689838 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:01.691350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:01.692506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-eb69be5d-0824-460e-9bf9-1123f55ee4c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.167473 May 11 19:04:01.693062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 480/943] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:01 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:01.784847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:01.785401 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:01.791915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.792393 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.793226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:01.793668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:01.924044 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:01.931554 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ee1e2ce5-d9dc-4916-b6ff-699a11a70ac7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.150615 May 11 19:04:01.932127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 464/944] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:01 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:02.535416 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:02.536195 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:02.543685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.544635 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.545840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.545840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.554331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:02.555479 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:02.563122 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.564037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.565369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.566527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.699752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:02.707779 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6562f6d8-d339-4b8b-89b5-69e2755c2d39 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.177766 May 11 19:04:02.717033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 481/945] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:02 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:02.723547 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:02.723852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:02.733082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.733616 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.735125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.735452 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.736840 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:02.745230 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aaecf3ef-f565-49e4-bb16-d55535334b2c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.195759 May 11 19:04:02.745817 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 465/946] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:02 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:02.885407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:02.894939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:02.896726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:02.898088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ef453385-caf4-4a94-8b92-4a0f483f8c95 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.188436 May 11 19:04:02.898646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 482/947] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:02 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:02.948631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:02.949247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:02.956331 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.956691 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:02.957468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:02.957912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:03.087981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:03.095834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e0974834-214f-4afd-8c3c-298274931325 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.151321 May 11 19:04:03.096403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 466/948] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:02 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:03.724673 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:03.725263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:03.731651 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:03.732109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:03.732863 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:03.733297 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:03.761720 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:03.762319 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:03.768146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:03.768589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:03.769345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:03.769773 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:03.861774 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:03.869262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6a332fb1-33e8-496c-b5dc-7d2f04a652d3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.148445 May 11 19:04:03.869842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 483/949] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:03 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:03.897853 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:03.905155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a65ad0e6-f02e-4693-a273-3e39b3f5249e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.147195 May 11 19:04:03.905726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 467/950] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:03 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:03.916676 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:03.917274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:03.923698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:03.924144 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:03.924899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:03.925332 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:04.052266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:04.060926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:04.061506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:04.062689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9ae83ecf-4112-45c8-a074-8ee3cdde72b2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.149902 May 11 19:04:04.063232 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 484/951] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:03 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:04.113284 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:04.113923 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:04.120174 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:04.120629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:04.121392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:04.121829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:04.250869 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:04.258188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fced6418-9230-4d9f-a0d2-8fc52d5f1406 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.149630 May 11 19:04:04.258693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 468/952] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:04 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:04.885832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:04.886430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:04.892753 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:04.893199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:04.893945 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:04.894377 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:04.921149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:04.922335 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:04.929528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:04.929987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:04.930770 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:04.931212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:05.024405 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:05.032329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-307ee358-ce3f-4d59-bfc3-e36040695717 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.150306 May 11 19:04:05.032926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 485/953] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:04 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:05.064105 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:05.071737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-979bccf6-c8d2-4e1d-a6a2-cf9f84b14b4a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.154637 May 11 19:04:05.072328 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 469/954] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:04 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:05.080781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:05.081383 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:05.087186 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:05.087664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:05.088428 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:05.088865 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:05.216794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:05.225107 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:05.226594 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:05.227780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c43b7ce0-7955-4bbc-8541-59de39998a1a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.150953 May 11 19:04:05.228331 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 486/955] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:05 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:05.274782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:05.275399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:05.282248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:05.282715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:05.283497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:05.283928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:05.407137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:05.414372 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c1bbd037-fa30-4681-9469-0e4afa9f1e64 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.143533 May 11 19:04:05.414963 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 470/956] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:05 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:06.049162 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:06.049774 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:06.056192 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.056668 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.057436 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.057874 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.088623 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:06.089241 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:06.095965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.096419 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.097201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.097778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.210213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:06.220182 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f92f4676-b940-46c6-b724-6db3502c76aa tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.172848 May 11 19:04:06.220842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 487/957] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:06 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:06.245744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:06.246441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:06.253183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.253724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.254593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.255118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.263359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:06.273339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ccd372ec-282e-4337-abd0-f9667931e7b2 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.187837 May 11 19:04:06.273928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 471/958] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:06 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:06.384244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:06.392890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:06.394406 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:06.395631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2ab5d645-e7c8-4785-961e-62a19c7078b9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.153766 May 11 19:04:06.396198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 488/959] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:06 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:04:06.430232 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:06.430832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:06.437565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.438012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.438777 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.439210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.571049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:06.578960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-80ce9310-cd2f-45ef-af0a-48351ef29df8 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.152505 May 11 19:04:06.579561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 472/960] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:06 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:06.911270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-c838c975-f00c-4582-9873-ff3f1e531235 req-3f4027b3-9f00-4136-9ce4-1dff68ab854b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1720b2d-be3b-4474-903d-326b5bc54244", "name": "network-vif-plugged", "status": "completed", "tag": "7731a148-77af-4830-adff-e06db2517e6e"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:06.919892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-c838c975-f00c-4582-9873-ff3f1e531235 req-3f4027b3-9f00-4136-9ce4-1dff68ab854b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:06.920440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-c838c975-f00c-4582-9873-ff3f1e531235 req-3f4027b3-9f00-4136-9ce4-1dff68ab854b service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:06.932163 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-c838c975-f00c-4582-9873-ff3f1e531235 req-3f4027b3-9f00-4136-9ce4-1dff68ab854b service nova] Creating event network-vif-plugged:7731a148-77af-4830-adff-e06db2517e6e for instance a1720b2d-be3b-4474-903d-326b5bc54244 on hv-cinder-75510 May 11 19:04:06.936963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-c838c975-f00c-4582-9873-ff3f1e531235 req-3f4027b3-9f00-4136-9ce4-1dff68ab854b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029392 May 11 19:04:06.938153 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 489/961] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:07.239360 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:07.239991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:07.249539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.250008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.250959 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.251268 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.291007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:07.291772 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:07.298770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.299224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.300049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.300488 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.395748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:07.403997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-13bd8fab-f642-4662-afb0-34fe7349c18e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.169920 May 11 19:04:07.405000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 473/962] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:07 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:07.413681 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:07.414582 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:07.420928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.421672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.422657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.423334 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.444214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:07.452113 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-04eabbda-de10-40c3-8d88-c342bc840dee tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.165826 May 11 19:04:07.453769 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 490/963] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:07 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:07.570150 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:07.579511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:07.581020 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:07.582459 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-500b1070-fa45-42c3-8fed-8bc33d43f539 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.172349 May 11 19:04:07.583027 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 474/964] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:07 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:04:07.602345 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:07.602956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:07.609404 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.609832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.610794 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:07.611529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:07.740851 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:07.748290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6070f922-20fc-4f17-b44c-d134ce099ec7 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.150215 May 11 19:04:07.748859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 491/965] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:07 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:08.422424 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:08.423132 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:08.429374 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.429848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.430566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.430993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.468619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:08.469341 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:08.475633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.476161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.476999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.477515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.564694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:08.573684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fb796de4-ea41-46c1-9542-aa7a29bf5e05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.155568 May 11 19:04:08.574317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 475/966] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:08 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:08.601586 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:08.602186 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:08.607994 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.608431 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.609527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:08.609728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.610160 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.617056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2389aefb-9aeb-4f8c-9466-36a2b3f36b46 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1367 microversion: 2.1 time: 0.152393 May 11 19:04:08.617736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 492/967] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:08 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:08.744513 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:08.752705 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:08.754327 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:08.755533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6aebcf80-0751-4868-acd9-e51d9d901190 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.157701 May 11 19:04:08.756086 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 476/968] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:08 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:04:08.765709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:08.766396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:08.772502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.772963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.773767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.774209 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.900343 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:08.908652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e60b14c9-935c-4f47-9977-2e604171d8ae tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.146667 May 11 19:04:08.909193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 493/969] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:08 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:08.975564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-cd8210dc-c78c-4249-84ed-a0300492839b req-a23cb279-e6be-4bf7-9b40-e80d76a35636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "name": "network-vif-plugged", "status": "completed", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}, {"server_uuid": "b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c", "name": "network-vif-plugged", "status": "completed", "tag": "92885fc5-1cdd-43af-99e2-42131f03dcaf"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:08.984191 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-cd8210dc-c78c-4249-84ed-a0300492839b req-a23cb279-e6be-4bf7-9b40-e80d76a35636 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:08.984629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-cd8210dc-c78c-4249-84ed-a0300492839b req-a23cb279-e6be-4bf7-9b40-e80d76a35636 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:08.997691 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-cd8210dc-c78c-4249-84ed-a0300492839b req-a23cb279-e6be-4bf7-9b40-e80d76a35636 service nova] Creating event network-vif-plugged:c94167a9-9991-43a1-8fe8-7f90f0e5fd82 for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b on hv-cinder-75510 May 11 19:04:08.998140 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-cd8210dc-c78c-4249-84ed-a0300492839b req-a23cb279-e6be-4bf7-9b40-e80d76a35636 service nova] Creating event network-vif-plugged:92885fc5-1cdd-43af-99e2-42131f03dcaf for instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c on hv-cinder-75510 May 11 19:04:09.004565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-cd8210dc-c78c-4249-84ed-a0300492839b req-a23cb279-e6be-4bf7-9b40-e80d76a35636 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032585 May 11 19:04:09.007546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 477/970] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:09.590274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:09.590905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:09.597641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.598278 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.599047 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.599508 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.634932 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:09.635756 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:09.644503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.646240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.647030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.647495 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.765922 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:09.774437 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b37c4d34-d345-41dc-8148-ed0c1a56d0d0 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.187958 May 11 19:04:09.775017 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 494/971] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:09 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:09.779827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:09.780421 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:09.787156 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.787655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.788419 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.788855 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.803630 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:09.812782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-350cf687-8c17-439f-8ed0-36ff4995c51a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1556 microversion: 2.1 time: 0.182410 May 11 19:04:09.813369 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 478/972] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:09 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:09.829808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:09.830551 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:09.836560 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.837016 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.837793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.838463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.918704 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-72fe40e1-f6ec-4ccb-b5bb-2d65cf5debea tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093467 May 11 19:04:09.919525 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 479/973] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 19:04:09 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:04:09.925636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:09.926241 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:09.932555 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.933238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.934400 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:09.935183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:09.936555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:09.945899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:09.947426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:09.948625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-45a87a6a-7989-4c41-a57b-c5a74122a330 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.172670 May 11 19:04:09.949511 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 495/974] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:09 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:10.221877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:10.230846 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c87d4112-fe5e-423c-8cb4-d386ae353599 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1362 microversion: 2.1 time: 0.309327 May 11 19:04:10.231581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 480/975] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:09 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:04:10.792552 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:10.793162 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:10.800674 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:10.801126 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:10.802138 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:10.802756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:10.957203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:10.964775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0c8ec408-7af8-4677-b05e-9da5f445cc59 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.176419 May 11 19:04:10.965672 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 496/976] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:10 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:10.967190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:10.969126 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:10.985686 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:10.986444 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:10.987504 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:10.988189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.017881 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-a353e20a-81b1-4d57-8d33-8ab5065128dc req-a91d4899-51e1-4fc5-a81f-b62eb055ff2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1720b2d-be3b-4474-903d-326b5bc54244", "tag": "7731a148-77af-4830-adff-e06db2517e6e"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:11.025848 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-a353e20a-81b1-4d57-8d33-8ab5065128dc req-a91d4899-51e1-4fc5-a81f-b62eb055ff2d service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.026295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-a353e20a-81b1-4d57-8d33-8ab5065128dc req-a91d4899-51e1-4fc5-a81f-b62eb055ff2d service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.039228 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-a353e20a-81b1-4d57-8d33-8ab5065128dc req-a91d4899-51e1-4fc5-a81f-b62eb055ff2d service nova] Creating event network-changed:7731a148-77af-4830-adff-e06db2517e6e for instance a1720b2d-be3b-4474-903d-326b5bc54244 on hv-cinder-75510 May 11 19:04:11.045117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-a353e20a-81b1-4d57-8d33-8ab5065128dc req-a91d4899-51e1-4fc5-a81f-b62eb055ff2d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 May 11 19:04:11.049719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 497/977] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:04:11.172870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:11.180984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:11.182596 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:11.184845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9979a698-f0f6-4de3-a237-268fbd251b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1744 microversion: 2.20 time: 0.222826 May 11 19:04:11.185860 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 481/978] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:10 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:04:11.249132 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:11.249861 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:11.256154 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.256609 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.257386 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.257827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.708871 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:11.717194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e23aa3f4-255e-422a-938b-7270eb14fd86 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1547 microversion: 2.1 time: 0.471910 May 11 19:04:11.718099 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 498/979] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:11 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1547 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:11.733102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:11.733969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:11.739948 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.740463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.741243 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.741680 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.825682 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f278c37e-3ddb-410d-b857-ac416005793d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096464 May 11 19:04:11.826280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 482/980] 10.222.0.93 () {58 vars in 1274 bytes} [Wed May 11 19:04:11 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:11.982514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:11.983212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:11.990914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.991643 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:11.992812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:11.993580 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:12.209808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:12.211642 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:12.220508 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:12.221278 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:12.222136 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:12.222585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:12.264645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:12.286259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-97672beb-da98-4cb2-94cb-38c1c2d0bfad tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1574 microversion: 2.1 time: 0.303863 May 11 19:04:12.286259 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 499/981] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:11 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1574 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:12.512645 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:12.520913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:12.522453 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:12.523915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-46435d2e-c4c7-416c-b372-63d9dcb36c30 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1744 microversion: 2.20 time: 0.323994 May 11 19:04:12.535324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 483/982] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:12 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1744 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:04:13.105819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-eefe660d-27ac-4bac-9446-8c69c1af9c25 req-a7eb9ce6-b3de-4f00-9229-fe6acb35cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c", "tag": "92885fc5-1cdd-43af-99e2-42131f03dcaf"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:13.125692 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-eefe660d-27ac-4bac-9446-8c69c1af9c25 req-a7eb9ce6-b3de-4f00-9229-fe6acb35cff9 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:13.126344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-eefe660d-27ac-4bac-9446-8c69c1af9c25 req-a7eb9ce6-b3de-4f00-9229-fe6acb35cff9 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:13.138557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-eefe660d-27ac-4bac-9446-8c69c1af9c25 req-a7eb9ce6-b3de-4f00-9229-fe6acb35cff9 service nova] Creating event network-changed:92885fc5-1cdd-43af-99e2-42131f03dcaf for instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c on hv-cinder-75510 May 11 19:04:13.144648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-eefe660d-27ac-4bac-9446-8c69c1af9c25 req-a7eb9ce6-b3de-4f00-9229-fe6acb35cff9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042366 May 11 19:04:13.145426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 500/983] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:13.298893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:13.300242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:13.307188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:13.307695 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:13.308490 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:13.309147 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:13.538664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:13.543438 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:13.544946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:13.554385 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-73af0674-e7d7-4d9d-ad0f-d0d47fd96fb3 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1561 microversion: 2.1 time: 0.258539 May 11 19:04:13.565438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 484/984] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:04:13 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1561 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:04:13.565696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:13.565696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:13.565696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:13.565696 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:13.813834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:13.824742 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:13.826265 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:13.831364 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a44b58e6-5f34-47e4-92aa-2dfcf5053cd3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1744 microversion: 2.20 time: 0.292906 May 11 19:04:13.844823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 501/985] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:13 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1744 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:04:14.850089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:14.850703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:14.857556 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:14.858359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:14.860040 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:14.860589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:15.032715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:15.046482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:15.048604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:15.053472 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aa6aa899-8060-4ad9-bd84-11ca77429dd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.207130 May 11 19:04:15.054288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 485/986] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:14 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:15.889070 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-38b5880f-5d4e-402b-bd48-48351aa173c5 req-5325ca65-9c8e-4186-9efe-db13b571fbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "name": "network-vif-plugged", "status": "completed", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:15.915821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-38b5880f-5d4e-402b-bd48-48351aa173c5 req-5325ca65-9c8e-4186-9efe-db13b571fbeb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:15.916358 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-38b5880f-5d4e-402b-bd48-48351aa173c5 req-5325ca65-9c8e-4186-9efe-db13b571fbeb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:15.946853 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-38b5880f-5d4e-402b-bd48-48351aa173c5 req-5325ca65-9c8e-4186-9efe-db13b571fbeb service nova] Creating event network-vif-plugged:4835742f-ec35-4b97-b6e6-227ad8b350fb for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 on hv-cinder-75510 May 11 19:04:15.957130 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-38b5880f-5d4e-402b-bd48-48351aa173c5 req-5325ca65-9c8e-4186-9efe-db13b571fbeb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071912 May 11 19:04:15.958486 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 502/987] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:16.072818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:16.074392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:16.082089 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:16.082544 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:16.083530 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:16.084135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:16.306519 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:16.320047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:16.322415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:16.324119 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-51c9fdeb-f67d-40bb-90c1-c0cba5c07c81 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.255426 May 11 19:04:16.325189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 486/988] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:16 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:17.352581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:17.354065 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:17.363973 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:17.364734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:17.368274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:17.368274 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:17.603468 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:17.615286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:17.617315 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:17.618965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-12960c71-c370-4a93-9f2a-d871391c7fd1 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.279706 May 11 19:04:17.620188 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 503/989] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:17 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:18.637804 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:18.641701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:18.649421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:18.649960 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:18.650636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:18.651100 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:18.836294 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:18.848668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:18.850396 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:18.851789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0613590b-0efb-43f7-84ba-78ffd0002100 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.217859 May 11 19:04:18.852896 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 487/990] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:18 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:19.871781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:19.872939 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:19.880489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:19.881330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:19.882330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:19.882833 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:20.062655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:20.079410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:20.081593 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:20.083862 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-10a4f4f1-2c9e-484c-a4a0-55fc7456743a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.216174 May 11 19:04:20.084583 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 504/991] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:19 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:21.105846 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:21.107157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:21.114503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:21.114988 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:21.118405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:21.119061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:21.268355 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:21.276565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:21.278212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:21.280916 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-01b0de3d-32e3-4e97-b0f0-5ce7ccfe5b7e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.178382 May 11 19:04:21.282750 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 488/992] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:21 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:22.300963 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:22.302286 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:22.308893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:22.309473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:22.310270 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:22.310710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:22.457844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:22.466834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:22.468908 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:22.470297 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-924b95c0-4cc5-4b06-b1ae-0d7b694ad346 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.173405 May 11 19:04:22.471015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 505/993] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:22 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:23.489152 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:23.489752 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:23.496469 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:23.497184 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:23.497974 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:23.498420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:23.649033 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:23.658347 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:23.660083 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:23.661252 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-4c99668a-9ea0-4e39-9d10-bd4f23494185 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1739 microversion: 2.20 time: 0.176179 May 11 19:04:23.661811 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 489/994] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:23 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:24.679971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:24.680607 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:24.687569 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:24.688027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:24.688800 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:24.689257 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:24.816884 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:24.824955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:24.826504 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:24.827697 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c7bffd3f-516d-454c-b825-f8c96112b3c7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1721 microversion: 2.20 time: 0.151627 May 11 19:04:24.828249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 506/995] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:24 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:25.846825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:25.847447 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:25.853637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:25.854078 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:25.854826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:25.855254 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:25.980819 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:25.989133 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:25.990688 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:25.991812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-886c4aa5-224c-4b97-a93c-2f099bb585b3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1721 microversion: 2.20 time: 0.149444 May 11 19:04:25.992394 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 490/996] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:25 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:27.009264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:27.009869 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:27.016685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:27.017133 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:27.017897 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:27.018333 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:27.152941 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:27.161886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:27.163569 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:27.164748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-85f6b318-e597-41e0-bd2b-aad2ac27089a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1721 microversion: 2.20 time: 0.159468 May 11 19:04:27.165387 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 507/997] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:27 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:27.847365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-cbb4165d-037b-4df4-a866-8403ca03f177 req-c65059d6-353b-45c4-8da2-ae83a27ca922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "name": "network-vif-unplugged", "status": "completed", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:27.857161 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-cbb4165d-037b-4df4-a866-8403ca03f177 req-c65059d6-353b-45c4-8da2-ae83a27ca922 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:27.857626 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-cbb4165d-037b-4df4-a866-8403ca03f177 req-c65059d6-353b-45c4-8da2-ae83a27ca922 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:27.872087 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.compute.server_external_events [req-cbb4165d-037b-4df4-a866-8403ca03f177 req-c65059d6-353b-45c4-8da2-ae83a27ca922 service nova] Unable to find a host for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720. Dropping event network-vif-unplugged {{(pid=117097) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 19:04:27.872969 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-cbb4165d-037b-4df4-a866-8403ca03f177 req-c65059d6-353b-45c4-8da2-ae83a27ca922 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029467 May 11 19:04:27.873572 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 491/998] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 19:04:28.182226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:28.182840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:28.189460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:28.189920 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:28.190726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:28.191169 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:28.321480 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:28.329376 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:28.330857 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:28.332063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a9e4a0d0-cd1a-4eb7-ae2a-ebe4dfdd6a39 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1664 microversion: 2.20 time: 0.153724 May 11 19:04:28.332611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 508/999] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:28 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:28.349838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eb2ddb1-cceb-4bc2-b767-8685d346137c"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:28.350912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:28.357391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:28.357845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:28.359179 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:28.359891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:28.614357 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-38505a42-594f-43ac-b1ac-cebe52fd2bb5 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.268311 May 11 19:04:28.615023 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 492/1000] 10.222.0.93 () {62 vars in 1363 bytes} [Wed May 11 19:04:28 2022] POST /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-volume_attachments => generated 188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 19:04:28.726499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:28.726992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:28.732824 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:28.733304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:28.734072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:28.734507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:28.976258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2b490347-b3e8-468e-b513-86f9ffb67701 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-volume_attachments/1eb2ddb1-cceb-4bc2-b767-8685d346137c" status: 202 len: 0 microversion: 2.20 time: 0.253687 May 11 19:04:28.976846 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 509/1001] 10.222.0.93 () {60 vars in 1456 bytes} [Wed May 11 19:04:28 2022] DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-volume_attachments/1eb2ddb1-cceb-4bc2-b767-8685d346137c => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 19:04:29.031585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:29.032156 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:29.038587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:29.039036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:29.039832 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:29.040279 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:29.117706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-96e6b61d-2cc8-4c55-88cc-34d4bd383577 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "POST /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/action" status: 202 len: 0 microversion: 2.20 time: 0.089943 May 11 19:04:29.119452 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 493/1002] 10.222.0.93 () {62 vars in 1318 bytes} [Wed May 11 19:04:29 2022] POST /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 19:04:29.126938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:29.127567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:29.134748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:29.135427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:29.136371 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:29.136624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:29.303285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:29.311128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:29.313229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:29.314403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2166475f-fe9f-4fac-ace4-7d32f560f0dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1672 microversion: 2.20 time: 0.191982 May 11 19:04:29.314977 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 510/1003] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:29 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1672 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:30.333266 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:30.333877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:30.340430 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:30.340895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:30.341658 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:30.342130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:30.538784 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:30.547675 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:30.549423 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:30.550756 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-90354597-d79c-4ef6-9e28-f4d1b7de45c3 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.221411 May 11 19:04:30.560871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 494/1004] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:30 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:31.571549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:31.572686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:31.586520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:31.588125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:31.590718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:31.591689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:31.791856 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:31.800676 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:31.802619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:31.804344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-48c09495-b221-4c94-9f10-17395fc37384 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.238347 May 11 19:04:31.822118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 511/1005] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:31 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:32.824549 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:32.825381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:32.833451 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:32.844469 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:32.845792 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:32.854965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:33.105913 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:33.114371 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:33.115909 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:33.117078 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bc2eb927-eecc-4f68-8db6-898de594bfbe tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.297382 May 11 19:04:33.117644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 495/1006] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:32 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:34.137152 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:34.138930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:34.146485 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:34.147201 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:34.148302 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:34.149420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:34.411115 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:34.419661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:34.422234 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:34.423773 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-cca51aa7-9efc-4bb7-8c19-4d6178687e69 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.292554 May 11 19:04:34.424877 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 512/1007] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:34 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:35.442274 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:35.443894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:35.464967 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:35.479090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:35.484830 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:35.486413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:35.746735 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:35.758721 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:35.761443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:35.763533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9faf7db1-9ab7-4803-85a7-eb888f609a8c tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.325162 May 11 19:04:35.765185 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 496/1008] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:35 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:36.782775 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:36.783497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:36.797021 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:36.798250 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:36.800597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:36.802613 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:37.100898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:37.109815 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:37.111678 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:37.112976 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-40477e81-a439-419c-bd50-16aeb5a030d8 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.334769 May 11 19:04:37.125425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 513/1009] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:36 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:38.132001 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:38.132648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:38.151497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:38.152000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:38.152825 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:38.153265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:38.683653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:38.698271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:38.702213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:38.705011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6c8b0606-35c3-4566-bd25-796d87606a21 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.577510 May 11 19:04:38.707474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 497/1010] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:38 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:39.728503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:39.728503 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:39.750280 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:39.751032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:39.752127 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:39.753056 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:40.011345 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:40.019812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:40.021320 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:40.022505 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c0c7ce4b-348e-4eb6-a269-642c846fb93b tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.302028 May 11 19:04:40.023042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 514/1011] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:39 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:41.043014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:41.044334 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:41.074477 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:41.075585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:41.077867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:41.081465 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:41.449472 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:41.458635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:41.476515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:41.478593 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5887df78-1784-40f2-9ec6-252494757a14 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.441516 May 11 19:04:41.492726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 498/1012] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:41 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:42.503701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:42.504407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:42.558414 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:42.559066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:42.559951 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:42.560398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:42.965427 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:42.989326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:42.994788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:42.996927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e8a589e6-a74a-4612-a40c-4e3bf6734a87 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.502717 May 11 19:04:43.009760 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 515/1013] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:42 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:44.030564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:44.032025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:44.043882 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:44.048673 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:44.049811 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:44.050797 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:44.255516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:44.267321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:44.268823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:44.270190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cb9b725b-e6a0-4766-92c6-760db9ea2c4d tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.245462 May 11 19:04:44.271280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 499/1014] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:44 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:44.909758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2eaa0aa6-e463-4815-b008-7f94d44532ef tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Action: 'create', calling method: .version_select at 0x7fa787665a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1150264539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAeiiFkRT8rcZ140625ea0J2mZMyXCOajT2T5Dte0GXzmU+O8l/Az93MIU8Uaj0xHsIrBcWb6+JVRPWb8WYkIIbKRDTBRLaEGqPGT28XZPyAelteUl/+cwIJHjbOaLNZg=="}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:44.924529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-2eaa0aa6-e463-4815-b008-7f94d44532ef tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:04:44.928910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-2eaa0aa6-e463-4815-b008-7f94d44532ef tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for user ead71051e3c548e7989007c8f5d0abc0 and project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'key_pairs'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:04:44.953496 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2eaa0aa6-e463-4815-b008-7f94d44532ef tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256395 May 11 19:04:44.954117 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 516/1015] 10.222.0.93 () {60 vars in 1158 bytes} [Wed May 11 19:04:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:04:45.289299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:45.290507 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:45.298069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:45.298865 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:45.299782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:45.300338 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:45.516058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:45.525039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:45.526751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:45.528058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bd8dcb88-18e2-43f2-b8bb-8bfcf66a8db7 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.243391 May 11 19:04:45.528679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 500/1016] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:45 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:46.548457 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:46.549174 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:46.556163 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:46.556785 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:46.557689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:46.558119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:46.740960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:46.752164 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:46.753678 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:46.755028 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-376501fb-0fcf-484d-81d0-5488496bb655 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.211217 May 11 19:04:46.756339 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 517/1017] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:46 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:47.775249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:47.776485 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:47.784985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:47.784985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:47.785231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:47.785718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:47.932664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:47.941215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:47.942716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:47.944227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b13d1faa-4649-4440-9b06-fc023285df34 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.174165 May 11 19:04:47.944789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 501/1018] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:47 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:48.157352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-e9dfdbbc-2bbc-444b-806a-c406f3b48f37 req-5066c088-6e49-4094-884c-15f7234709ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "name": "network-vif-plugged", "status": "completed", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:48.166346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-e9dfdbbc-2bbc-444b-806a-c406f3b48f37 req-5066c088-6e49-4094-884c-15f7234709ee service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:48.166857 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-e9dfdbbc-2bbc-444b-806a-c406f3b48f37 req-5066c088-6e49-4094-884c-15f7234709ee service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:48.186780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-e9dfdbbc-2bbc-444b-806a-c406f3b48f37 req-5066c088-6e49-4094-884c-15f7234709ee service nova] Creating event network-vif-plugged:4835742f-ec35-4b97-b6e6-227ad8b350fb for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 on hv-cinder-75510 May 11 19:04:48.192525 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-e9dfdbbc-2bbc-444b-806a-c406f3b48f37 req-5066c088-6e49-4094-884c-15f7234709ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038785 May 11 19:04:48.193982 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 518/1019] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:48.962742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:48.963824 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:48.970769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:48.971219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:48.972011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:48.972450 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:49.098380 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:49.106807 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:49.108405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:49.109567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-01de0429-b675-4250-9cf7-d2827b611ebf tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.150721 May 11 19:04:49.110126 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 502/1020] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:48 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:50.128419 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:50.129116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:50.135335 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:50.135798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:50.136574 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:50.137013 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:50.273710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:50.284661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:50.286227 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:50.287426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7cb48770-01f7-47de-9193-d5cc62fa62c2 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1730 microversion: 2.20 time: 0.163924 May 11 19:04:50.287985 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 519/1021] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:50 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:51.305219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:51.305817 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:51.312728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:51.313164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:51.313916 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:51.314343 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:51.453318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:51.463096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:51.464762 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:04:51.465986 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cb5479f4-38c5-4933-9f3a-eb5e307dc2c6 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1717 microversion: 2.20 time: 0.164624 May 11 19:04:51.466557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 503/1022] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:04:51 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:04:58.632151 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:04:58.632666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:58.639680 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:58.640134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:58.640905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:58.641344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:58.664253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-87e89910-48e9-4f29-a71e-845a1e6db524 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/ips" status: 200 len: 149 microversion: 2.1 time: 0.036107 May 11 19:04:58.664818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 520/1023] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 19:04:58 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:04:59.970647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c17f4cd9-e14f-4a79-a533-6819c026488a"}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:04:59.971798 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:04:59.978126 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:59.978576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:04:59.979378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:04:59.979818 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:00.153271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:00.153842 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:00.160631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:00.161082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:00.161844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:00.162273 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:00.184984 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4a0a3a4c-b1f6-4496-99bf-bf81c91774cc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/ips" status: 200 len: 145 microversion: 2.1 time: 0.035544 May 11 19:05:00.185554 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 521/1024] 10.222.0.93 () {58 vars in 1247 bytes} [Wed May 11 19:05:00 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:05:00.417423 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-95ecfa7c-cd81-47b9-b275-8edbe5e13694 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "POST /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450828 May 11 19:05:00.418370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 504/1025] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:04:59 2022] POST /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:01.506955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5eb0e86-1b2e-4fb8-a400-abb5b739849f"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:01.507992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:01.514770 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:01.515236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:01.516062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:01.516762 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:01.799684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-96cce576-7494-4aa2-929a-ada3dd0a33fa tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296535 May 11 19:05:01.800291 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 522/1026] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:05:01 2022] POST /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:03.343161 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-777409474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1150264539", "security_groups": [{"name": "tempest-secgroup-smoke-809237043"}], "block_device_mapping_v2": [{"uuid": "37c6eb8b-8f70-421d-8ef3-5d1bf1fbd519", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3cca2bc-d77d-445f-bc7f-2c39c608cd4e"}]}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:03.456942 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] validate_networks() for [('f3cca2bc-d77d-445f-bc7f-2c39c608cd4e', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:05:03.819793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:05:03.820221 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:05:03.820696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:05:03.821130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:05:03.821541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:05:03.830533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:03.830984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:03.831826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:03.832265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:03.848838 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:05:03.852693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for user ead71051e3c548e7989007c8f5d0abc0 and project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:05:03.907260 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:05:03.909503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37c6eb8b-8f70-421d-8ef3-5d1bf1fbd519',volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:05:04.033448 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-944db078-cd7e-47f3-b124-5edc7c8f0232 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.694986 May 11 19:05:04.034085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 505/1027] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:05:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:05:04.045167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-52c13c90-4c01-4869-9e28-559869f86649 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:04.045857 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-52c13c90-4c01-4869-9e28-559869f86649 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:04.099710 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-52c13c90-4c01-4869-9e28-559869f86649 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:04.106307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-52c13c90-4c01-4869-9e28-559869f86649 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1094 microversion: 2.1 time: 0.065931 May 11 19:05:04.106880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 523/1028] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:04 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:05.123731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:05.124346 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:05.131069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:05.131561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:05.132324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:05.132763 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:05.211870 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:05.219477 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b49d9154-470c-4725-8ca4-6cef1d65819a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1210 microversion: 2.1 time: 0.100420 May 11 19:05:05.219974 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 506/1029] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:05 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:06.237194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:06.238776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:06.246397 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:06.247081 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:06.249146 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:06.249599 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:06.388751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:06.396629 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e886a3ba-d532-4657-93b6-13a8a3083d32 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.164091 May 11 19:05:06.397633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 524/1030] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:06 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:06.463004 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-1dfae291-7e35-455f-926f-728a65897c4b req-adf57689-d455-4b96-887b-dbd27a750aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ffc6c7-d651-46de-871e-3ad46ec97a88", "tag": "d0ac5c5d-fe7d-4831-954a-d5bee6c73eec"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:06.479035 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-1dfae291-7e35-455f-926f-728a65897c4b req-adf57689-d455-4b96-887b-dbd27a750aa1 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:06.479553 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-1dfae291-7e35-455f-926f-728a65897c4b req-adf57689-d455-4b96-887b-dbd27a750aa1 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:06.492367 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-1dfae291-7e35-455f-926f-728a65897c4b req-adf57689-d455-4b96-887b-dbd27a750aa1 service nova] Creating event network-changed:d0ac5c5d-fe7d-4831-954a-d5bee6c73eec for instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 on hv-cinder-75510 May 11 19:05:06.498359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-1dfae291-7e35-455f-926f-728a65897c4b req-adf57689-d455-4b96-887b-dbd27a750aa1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044942 May 11 19:05:06.499698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 507/1031] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:05:07.414015 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:07.414636 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:07.421533 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:07.421986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:07.422755 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:07.423198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:07.565656 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:07.575105 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-9b6f2eca-cf3f-4839-bb41-1c6e0ec7c5fa tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.164877 May 11 19:05:07.575756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 525/1032] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:07 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:08.016345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:08.016928 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:08.023452 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:08.023905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:08.024732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:08.025194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:08.104766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lazy-loading 'services' on Instance uuid a1720b2d-be3b-4474-903d-326b5bc54244 {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:08.208342 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-9cbd0410-4e6c-4c64-a547-c2339c4723d8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments/c17f4cd9-e14f-4a79-a533-6819c026488a" status: 202 len: 0 microversion: 2.1 time: 0.196071 May 11 19:05:08.209061 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 508/1033] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:05:08 2022] DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments/c17f4cd9-e14f-4a79-a533-6819c026488a => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:05:08.218837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:08.219859 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:08.226952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:08.227602 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:08.228337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:08.229296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:08.258705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b1440801-f059-4d0a-b320-b00158b5634b tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 May 11 19:05:08.259269 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 526/1034] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:08 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:08.592110 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:08.592839 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:08.598944 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:08.599438 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:08.600213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:08.600659 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:08.733548 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:08.740836 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-65f7a2b3-747a-4c68-806e-eef0fe291454 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.153105 May 11 19:05:08.741391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 509/1035] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:08 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:09.270001 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:09.270923 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:09.277298 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:09.277756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:09.278527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:09.279491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:09.307967 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-14f43e6a-aba5-46f4-a586-ef2572f542c5 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 May 11 19:05:09.308519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 527/1036] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:09 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:09.757961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:09.758578 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:09.765657 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:09.766113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:09.766892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:09.767431 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:09.893363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:09.900698 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-98f7e620-f210-40b8-aa02-37c7b508fd7a tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.146623 May 11 19:05:09.901260 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 510/1037] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:09 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:10.319641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:10.320564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:10.326935 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:10.327434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:10.328208 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:10.328648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:10.372805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b099e462-3f5b-4737-89bf-13f1e9936731 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057352 May 11 19:05:10.373366 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 528/1038] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:10 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:10.917813 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:10.918415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:10.925069 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:10.925518 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:10.926280 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:10.926718 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:11.051964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:11.059486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-324f8356-d335-4639-a76d-17437b0b26c0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.145429 May 11 19:05:11.060047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 511/1039] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:10 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:11.384262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:11.385176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:11.391428 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:11.391875 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:11.392627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:11.393059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:11.421042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-0ba6e9c0-027c-4708-abaa-b7e4a448c602 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 May 11 19:05:11.421588 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 529/1040] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:11 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:12.076527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:12.077134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:12.083541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:12.083994 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:12.084758 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:12.085198 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:12.215095 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:12.223096 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-02f7c970-8e8d-4317-88c1-1d961abfd3f5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.150942 May 11 19:05:12.223679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 512/1041] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:12 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:12.432417 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:12.433329 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:12.440207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:12.440652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:12.441409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:12.441856 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:12.470360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e82aa735-f7fc-4431-8120-05acfb5ad68f tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041977 May 11 19:05:12.470901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 530/1042] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:12 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:13.239895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:13.240512 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:13.246917 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:13.247410 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:13.248249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:13.248692 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:13.374233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:13.381570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0c6d9944-e3a7-42e1-9e94-30c2dcc16ba2 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.145566 May 11 19:05:13.382135 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 513/1043] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:13 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:13.481918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:13.482811 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:13.489169 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:13.489624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:13.490391 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:13.490829 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:13.519198 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a25401e5-044d-486e-a40c-cbda29c94f4d tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041330 May 11 19:05:13.519782 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 531/1044] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:13 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:14.398874 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:14.399462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:14.405687 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.406134 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.406887 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.407338 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.528183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:14.529614 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:14.536221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.536674 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.537457 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.537899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.541949 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:14.549947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-875b0861-b87d-4153-aeff-326de7ed61f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1277 microversion: 2.1 time: 0.155035 May 11 19:05:14.550516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 514/1045] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:14 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:14.555567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:14.556993 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:14.562921 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.563420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.564194 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.564629 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.568246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-540dbea8-6c27-4237-b235-208ee51b23de tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 May 11 19:05:14.569088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 532/1046] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:14 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:05:14.578848 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:14.579365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:14.585062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.585517 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.586288 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:14.586727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:14.596762 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7b6ce3a6-49d8-44c9-bda5-3737754e007c tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 May 11 19:05:14.597325 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 515/1047] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:14 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:14.615785 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e5e21114-3903-4c85-a1a7-2e47676d1028 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/c5eb0e86-1b2e-4fb8-a400-abb5b739849f" status: 200 len: 194 microversion: 2.1 time: 0.040553 May 11 19:05:14.616698 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 533/1048] 10.222.0.93 () {58 vars in 1412 bytes} [Wed May 11 19:05:14 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/c5eb0e86-1b2e-4fb8-a400-abb5b739849f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:15.565924 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:15.566489 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:15.573254 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:15.573706 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:15.574509 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:15.574946 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:15.609059 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:15.610084 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:15.616716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:15.617303 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:15.618100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:15.618548 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:15.649630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-feccc4f3-77d7-4f47-8b5c-8eeef619e477 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 May 11 19:05:15.651409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 534/1049] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:15 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:05:15.711017 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:15.718953 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-faec9b2a-b5a6-4c8f-a4e4-95e93eaec820 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.156970 May 11 19:05:15.719547 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 516/1050] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:15 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:15.925251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eb32d01-d456-4ff1-abeb-6c711b5964ac"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:15.926313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:15.932823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:15.933434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:15.934268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:15.934809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.181823 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-acf18489-2171-4939-a53a-258b2e91cd1d tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "POST /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260252 May 11 19:05:16.184128 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 535/1051] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:05:15 2022] POST /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:16.661425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:16.662345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:16.668806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.669267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.670030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.670474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.697884 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-381ef05d-d71e-4ba3-a0f8-8bdb9e82873e tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040464 May 11 19:05:16.698429 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 517/1052] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:16 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:05:16.737139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:16.737831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:16.744510 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.744510 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.745440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.745966 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.754942 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:16.755469 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:16.761219 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.761669 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.762430 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.762871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.787991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:05:16.865659 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fa29436a-953b-477d-90ea-8417e3fccc61 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 204 len: 0 microversion: 2.1 time: 0.114143 May 11 19:05:16.866242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 518/1053] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:16 2022] DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 19:05:16.875890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:16.876930 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:16.883145 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.883636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.884213 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:16.884402 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:16.884812 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:16.893215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-91da0ca2-17bb-4ea5-868c-ce844ab146da tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.159899 May 11 19:05:16.893215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 536/1054] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:16 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:17.016749 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:17.024404 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ce15d24e-8a39-40bd-a9ce-46f81fa13dc0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1681 microversion: 2.1 time: 0.153599 May 11 19:05:17.024968 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 519/1055] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:16 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:05:17.914982 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:17.915693 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:17.922049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:17.922501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:17.923264 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:17.923753 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:18.042474 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:18.043118 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:18.050244 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:18.050693 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:18.051498 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:18.051934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:18.071968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:18.079340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-17835693-e140-4d4b-b3f7-75f53721a195 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.168313 May 11 19:05:18.079915 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 537/1056] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:17 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:18.188805 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:18.196480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fe613826-8fe9-4db5-bbd5-beddf7bd3bbf tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1681 microversion: 2.1 time: 0.158032 May 11 19:05:18.197043 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 520/1057] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:18 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:05:19.096884 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:19.097450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:19.103685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:19.104131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:19.104899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:19.105330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:19.214130 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:19.214737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:19.221394 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:19.222049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:19.222821 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:19.223242 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:19.241753 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:19.250560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e95f9c5b-a0ee-456a-997c-1abc58b218b0 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.158100 May 11 19:05:19.251263 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 538/1058] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:19 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:19.320388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:19.329539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c28b9fd2-ab31-4fa0-ab55-84f3cb701446 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1614 microversion: 2.1 time: 0.119354 May 11 19:05:19.330247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 521/1059] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:19 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:19.836572 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-439e1d02-b60c-4b43-b280-db49f104f0c5 req-d65da952-8ac4-46b1-b2f7-41583437751f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1720b2d-be3b-4474-903d-326b5bc54244", "name": "network-vif-deleted", "tag": "7731a148-77af-4830-adff-e06db2517e6e"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:19.845262 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-439e1d02-b60c-4b43-b280-db49f104f0c5 req-d65da952-8ac4-46b1-b2f7-41583437751f service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:19.845716 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-439e1d02-b60c-4b43-b280-db49f104f0c5 req-d65da952-8ac4-46b1-b2f7-41583437751f service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:19.857376 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-439e1d02-b60c-4b43-b280-db49f104f0c5 req-d65da952-8ac4-46b1-b2f7-41583437751f service nova] Creating event network-vif-deleted:7731a148-77af-4830-adff-e06db2517e6e for instance a1720b2d-be3b-4474-903d-326b5bc54244 on hv-cinder-75510 May 11 19:05:19.862293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-439e1d02-b60c-4b43-b280-db49f104f0c5 req-d65da952-8ac4-46b1-b2f7-41583437751f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029373 May 11 19:05:19.862907 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 539/1060] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:20.267950 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:20.268920 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:20.275151 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:20.275637 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:20.276412 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:20.276851 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:20.348556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:20.349254 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:20.356114 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:20.356890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:20.357875 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:20.358504 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:20.397378 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:20.397883 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:20.398646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lazy-loading 'fault' on Instance uuid a1720b2d-be3b-4474-903d-326b5bc54244 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:20.430091 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:20.445674 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-61691f19-d314-414d-93c9-233a497c3fad tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.181559 May 11 19:05:20.447218 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 522/1061] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:20 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:20.472914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f10686b4814794aadc34ec6194cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286035250ee843e696e2422db9319f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:20.481239 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-60f42195-1b85-49e0-aac4-d63259537cf8 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 200 len: 1332 microversion: 2.1 time: 0.136810 May 11 19:05:20.486363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 540/1062] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:20 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:05:21.465169 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:21.465727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:21.471981 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:21.472423 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:21.473175 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:21.473606 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:21.498752 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:21.499932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:21.506244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:21.506701 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:21.507516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:21.507968 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:21.522367 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 HTTP/1.1 May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:21.524061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:21.525473 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'a1720b2d-be3b-4474-903d-326b5bc54244'} May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:21.526241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:21.527524 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:21.528642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:21.528642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-274183ac-6816-424e-98a0-2017bdaa09fb tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 404 len: 111 microversion: 2.1 time: 0.031426 May 11 19:05:21.529804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 541/1063] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:21 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 19:05:21.535183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-eb380de9-4b20-4924-a7e9-4e122567e279 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '.version_select at 0x7fa78756c040>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:21.552932 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-eb380de9-4b20-4924-a7e9-4e122567e279 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079985342" status: 202 len: 0 microversion: 2.1 time: 0.021885 May 11 19:05:21.553518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 542/1064] 10.222.0.93 () {58 vars in 1220 bytes} [Wed May 11 19:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079985342 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:05:21.612116 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:21.619664 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-506c8932-9e1f-47bd-ba11-09722a85a476 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.158468 May 11 19:05:21.620322 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 523/1065] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:21 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:22.638403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:22.638948 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:22.645544 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:22.645991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:22.646746 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:22.647177 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:22.776349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:22.783852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-65f382df-19f8-4f3c-ab34-fc75de0fb654 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.150335 May 11 19:05:22.784417 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 543/1066] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:22 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:23.288053 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:23.288541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:23.295259 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:23.295754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:23.296516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:23.296953 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:23.310754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 HTTP/1.1 May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:23.312482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.314039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'a1720b2d-be3b-4474-903d-326b5bc54244'} May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:23.314856 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.316378 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:23.317933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:23.317933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3a6eb05a-c5c3-4f50-aa2b-be19c20e99c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 404 len: 111 microversion: 2.1 time: 0.029718 May 11 19:05:23.317933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 524/1067] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:23 2022] DELETE /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:23.322646 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:23.323246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: a1720b2d-be3b-4474-903d-326b5bc54244] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:23.329370 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:23.329856 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:23.330654 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:23.331095 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:23.344460 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 HTTP/1.1 May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:23.345969 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.347506 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'a1720b2d-be3b-4474-903d-326b5bc54244'} May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:23.348515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. May 11 19:05:23.349949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:23.351246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance a1720b2d-be3b-4474-903d-326b5bc54244 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:23.351246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ff228a45-1d21-4b2d-a8c6-3b407d9fa7e0 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244" status: 404 len: 111 microversion: 2.1 time: 0.028819 May 11 19:05:23.351246 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 544/1068] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:23 2022] GET /compute/v2.1/servers/a1720b2d-be3b-4474-903d-326b5bc54244 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:23.801989 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:23.802628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:23.809085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:23.809645 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:23.810512 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:23.810951 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:23.942312 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:23.950922 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bf804a23-51ef-4811-9142-03d11cb00750 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.153214 May 11 19:05:23.951516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 525/1069] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:23 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:05:24.394424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-7b9ccbb7-2f43-4e61-b709-b96c013f195d req-5f197c80-bd87-480b-9780-ba66d5c5c1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ffc6c7-d651-46de-871e-3ad46ec97a88", "name": "network-vif-plugged", "status": "completed", "tag": "d0ac5c5d-fe7d-4831-954a-d5bee6c73eec"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:24.403927 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-7b9ccbb7-2f43-4e61-b709-b96c013f195d req-5f197c80-bd87-480b-9780-ba66d5c5c1ae service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.404402 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-7b9ccbb7-2f43-4e61-b709-b96c013f195d req-5f197c80-bd87-480b-9780-ba66d5c5c1ae service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.415641 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-7b9ccbb7-2f43-4e61-b709-b96c013f195d req-5f197c80-bd87-480b-9780-ba66d5c5c1ae service nova] Creating event network-vif-plugged:d0ac5c5d-fe7d-4831-954a-d5bee6c73eec for instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 on hv-cinder-75510 May 11 19:05:24.420928 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-7b9ccbb7-2f43-4e61-b709-b96c013f195d req-5f197c80-bd87-480b-9780-ba66d5c5c1ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030208 May 11 19:05:24.421669 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 545/1070] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:24.475894 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.476379 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.483478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.483925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.484985 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.485413 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.502740 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e HTTP/1.1 May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:24.504341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.505775 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '98ab7e74-4252-4c1c-93c0-321e87317c2e'} May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:24.506671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.507871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.509060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:24.509060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e8a58a91-f026-4da9-996e-f7c808568a48 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 404 len: 111 microversion: 2.1 time: 0.033942 May 11 19:05:24.509060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 526/1071] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:24 2022] DELETE /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:24.515188 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.515923 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 98ab7e74-4252-4c1c-93c0-321e87317c2e] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.522156 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.522611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.523499 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.523946 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.543088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e HTTP/1.1 May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:24.545433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.547048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '98ab7e74-4252-4c1c-93c0-321e87317c2e'} May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:24.547980 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. May 11 19:05:24.549139 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.550344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 98ab7e74-4252-4c1c-93c0-321e87317c2e could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:24.550344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-16939851-9a0a-40a0-993f-d1a64802580a tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e" status: 404 len: 111 microversion: 2.1 time: 0.035956 May 11 19:05:24.550344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 546/1072] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:24 2022] GET /compute/v2.1/servers/98ab7e74-4252-4c1c-93c0-321e87317c2e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:24.557480 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.558556 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.564609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.565058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.565859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.566323 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.580739 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a HTTP/1.1 May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:24.582267 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.583871 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '566e7940-0d8b-421c-87de-d7fc5c7db98a'} May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:24.584790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.586204 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:24.588301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:24.588301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d5db6dea-7d13-400c-bb90-6a327ea5aa51 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 404 len: 111 microversion: 2.1 time: 0.031425 May 11 19:05:24.588301 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 527/1073] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:24 2022] DELETE /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:24.592564 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.593176 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 566e7940-0d8b-421c-87de-d7fc5c7db98a] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.599258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.599741 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.600507 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.600949 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.616448 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a HTTP/1.1 May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:24.617950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.619483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '566e7940-0d8b-421c-87de-d7fc5c7db98a'} May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:24.620350 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. May 11 19:05:24.621817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:24.626281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 566e7940-0d8b-421c-87de-d7fc5c7db98a could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:24.626281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-508af86b-b159-4caf-85a6-bde3fbeaf1c1 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a" status: 404 len: 111 microversion: 2.1 time: 0.031125 May 11 19:05:24.626281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 547/1074] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:24 2022] GET /compute/v2.1/servers/566e7940-0d8b-421c-87de-d7fc5c7db98a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:24.793411 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.794451 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.800557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.801008 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.801776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.802216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.833112 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aee35f04-be32-44f9-bff9-f01193b184ad tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044772 May 11 19:05:24.833661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 528/1075] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:24 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:24.968726 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.969241 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.975281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.975766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.976536 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.976974 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.978654 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:24.979392 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:24.985389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.985835 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:24.986647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:24.987088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.016847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ae277bbc-5a23-4571-86b3-76c9f7b123e3 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/c5eb0e86-1b2e-4fb8-a400-abb5b739849f" status: 200 len: 194 microversion: 2.1 time: 0.042017 May 11 19:05:25.017626 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 529/1076] 10.222.0.93 () {58 vars in 1412 bytes} [Wed May 11 19:05:24 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/c5eb0e86-1b2e-4fb8-a400-abb5b739849f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:05:25.026895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:25.027408 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:25.033462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:25.033914 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.034741 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:25.035268 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.115234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lazy-loading 'services' on Instance uuid b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:25.116953 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:25.124776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-45a61506-7cc0-49a0-8926-84554295df0f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.160677 May 11 19:05:25.125348 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 548/1077] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:24 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:25.184146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-82a84aa2-f52c-40c0-ad11-6a2f5dd7a98a tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/c5eb0e86-1b2e-4fb8-a400-abb5b739849f" status: 202 len: 0 microversion: 2.1 time: 0.160882 May 11 19:05:25.184604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 530/1078] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:05:25 2022] DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/c5eb0e86-1b2e-4fb8-a400-abb5b739849f => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:05:25.768767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:25.769304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:25.775619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:25.776077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.776845 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:25.777287 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.791091 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 HTTP/1.1 May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:25.792645 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.794727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '448cb11d-d94b-46e6-bf14-e2ee5b9e93a6'} May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:25.795626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.796993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:25.798349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:25.798349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fe93d9ba-09ec-4c95-924b-43d95c879c22 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 404 len: 111 microversion: 2.1 time: 0.029198 May 11 19:05:25.798349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 549/1079] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:25 2022] DELETE /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:25.803966 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:25.804671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] [instance: 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:25.810783 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:25.811238 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.812038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:25.812477 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:25.825744 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] HTTP exception thrown: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Request method failure captured: May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 HTTP/1.1 May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc412ACi9BBSUgbWNY6UZVa-4W_oCfgl8AOdcn6KMlfRdLg4XZdryIwUu8UBUECvrxjnrf_DeR1gF-4heR_QJRvrOwZ0lgXSxrcJralOwNzqa8HZph-TtrwpK7c3FpfLtfhvdOg0cpgD-FOxZEL1PfQGEFIx1Xmhj1Q8DVF7MuXqoQ May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:25.827271 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/286035250ee843e696e2422db9319f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_286035250ee843e696e2422db9319f4f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/286035250ee843e696e2422db9319f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 286035250ee843e696e2422db9319f4f May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196591122 May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f1f10686b4814794aadc34ec6194cc6b May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeNegativeTest-1196591122-project May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.828754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '448cb11d-d94b-46e6-bf14-e2ee5b9e93a6'} May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:25.829701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. May 11 19:05:25.831090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:25.832631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] Returning 404 to user: Instance 448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:25.832631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-06e4b0ad-8619-42fe-9398-86280c43a244 tempest-AttachVolumeNegativeTest-1196591122 tempest-AttachVolumeNegativeTest-1196591122-project] 10.222.0.93 "GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6" status: 404 len: 111 microversion: 2.1 time: 0.029413 May 11 19:05:25.832631 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 531/1080] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:25 2022] GET /compute/v2.1/servers/448cb11d-d94b-46e6-bf14-e2ee5b9e93a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:26.142407 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:26.142928 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:26.148860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:26.149319 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:26.150194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:26.150639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:26.363450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:26.370694 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fdd5fc6b-14c0-4714-b35e-eb36b3fcefa1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1265 microversion: 2.1 time: 0.232771 May 11 19:05:26.371266 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 550/1081] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:26 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:27.387080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:27.388382 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:27.395215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:27.395715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:27.396501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:27.396991 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:27.551231 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:27.559514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3c84bb85-a1ac-4991-ac66-81cdeb8f33dc tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1453 microversion: 2.1 time: 0.176359 May 11 19:05:27.561043 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 532/1082] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:27 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:27.578351 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:27.578956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:27.585756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:27.586292 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:27.587202 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:27.587705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:28.062981 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:28.070827 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f0167277-c0a3-4556-b893-124ada096a61 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1453 microversion: 2.1 time: 0.497416 May 11 19:05:28.071424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 551/1083] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:27 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1453 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:28.402794 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:28.403995 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:28.410694 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:28.411142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:28.411987 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:28.412441 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:28.442087 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cb61ee83-be13-4f3c-ad06-a1fb09bd2868 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/1eb32d01-d456-4ff1-abeb-6c711b5964ac" status: 200 len: 194 microversion: 2.1 time: 0.043169 May 11 19:05:28.443009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 533/1084] 10.222.0.93 () {58 vars in 1412 bytes} [Wed May 11 19:05:28 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/1eb32d01-d456-4ff1-abeb-6c711b5964ac => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:28.453491 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:28.454189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:28.460155 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:28.460686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:28.461585 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:28.462075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:28.556077 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lazy-loading 'services' on Instance uuid b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:28.649396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8cce164c-e388-4149-9e78-b93bbdf59314 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/1eb32d01-d456-4ff1-abeb-6c711b5964ac" status: 202 len: 0 microversion: 2.1 time: 0.200167 May 11 19:05:28.651702 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 552/1085] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:05:28 2022] DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments/1eb32d01-d456-4ff1-abeb-6c711b5964ac => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:05:29.850226 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:29.851342 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:29.858527 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:29.859060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:29.859964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:29.860666 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:29.890240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bb5f7d6b-ac92-4a6e-a511-d262a3797536 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044007 May 11 19:05:29.890964 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 534/1086] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:29 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:05:30.028979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:30.029997 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:30.036336 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.036793 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.037756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.038418 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.082387 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ea8ec577-8708-46d7-adc0-bf4cadc3dc6b tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058871 May 11 19:05:30.083230 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 553/1087] 10.222.0.93 () {58 vars in 1301 bytes} [Wed May 11 19:05:30 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 19:05:30.118287 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-8d3528a6-51d8-42a3-bd12-5a552d9182fa req-7235dd41-066c-4bd1-bf20-c398344aa597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ffc6c7-d651-46de-871e-3ad46ec97a88", "tag": "d0ac5c5d-fe7d-4831-954a-d5bee6c73eec"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:30.132372 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-8d3528a6-51d8-42a3-bd12-5a552d9182fa req-7235dd41-066c-4bd1-bf20-c398344aa597 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.132829 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-8d3528a6-51d8-42a3-bd12-5a552d9182fa req-7235dd41-066c-4bd1-bf20-c398344aa597 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.145370 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-8d3528a6-51d8-42a3-bd12-5a552d9182fa req-7235dd41-066c-4bd1-bf20-c398344aa597 service nova] Creating event network-changed:d0ac5c5d-fe7d-4831-954a-d5bee6c73eec for instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 on hv-cinder-75510 May 11 19:05:30.150872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-8d3528a6-51d8-42a3-bd12-5a552d9182fa req-7235dd41-066c-4bd1-bf20-c398344aa597 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037751 May 11 19:05:30.151911 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 535/1088] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:30.162143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:30.162639 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:30.168560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.169082 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.169855 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.170291 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.195443 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:05:30.309238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-aa248990-02c2-4a6c-87f5-569074506ff2 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 204 len: 0 microversion: 2.1 time: 0.150623 May 11 19:05:30.309887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 554/1089] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:30 2022] DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:05:30.319511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:30.320213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:30.326679 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.327255 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.328282 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:30.329030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:30.491598 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:30.500021 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-69d62bde-3886-4e4e-ae63-ecc32c2b6768 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1672 microversion: 2.1 time: 0.185616 May 11 19:05:30.500806 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 536/1090] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:30 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:31.517995 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:31.518684 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:31.525168 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:31.525616 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:31.526381 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:31.526817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:31.666024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:31.674628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-27eaf6aa-ee80-452e-98eb-b12a06e2dd39 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1672 microversion: 2.1 time: 0.160828 May 11 19:05:31.675205 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 555/1091] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:31 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:32.691699 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:32.692306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:32.700188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:32.701748 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:32.702685 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:32.704014 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:32.885062 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:32.892872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e07edf12-67f6-488d-99f2-088885a459ea tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1672 microversion: 2.1 time: 0.205087 May 11 19:05:32.902183 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 537/1092] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:32 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1672 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:05:33.513445 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-97258c1b-470a-499e-a239-1d65d01bf946 req-0957b2bf-e0ba-418e-9941-b797ab53cd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c", "name": "network-vif-deleted", "tag": "92885fc5-1cdd-43af-99e2-42131f03dcaf"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:33.524494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-97258c1b-470a-499e-a239-1d65d01bf946 req-0957b2bf-e0ba-418e-9941-b797ab53cd04 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.525844 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-97258c1b-470a-499e-a239-1d65d01bf946 req-0957b2bf-e0ba-418e-9941-b797ab53cd04 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.544782 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-97258c1b-470a-499e-a239-1d65d01bf946 req-0957b2bf-e0ba-418e-9941-b797ab53cd04 service nova] Creating event network-vif-deleted:92885fc5-1cdd-43af-99e2-42131f03dcaf for instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c on hv-cinder-75510 May 11 19:05:33.551610 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-97258c1b-470a-499e-a239-1d65d01bf946 req-0957b2bf-e0ba-418e-9941-b797ab53cd04 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043357 May 11 19:05:33.556662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 556/1093] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:33.575349 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:33.577029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:33.583414 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.584202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.585265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.585848 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.634766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-80cd9bf3-c86b-40cb-862a-6e73e98dcbdc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063429 May 11 19:05:33.635896 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 538/1094] 10.222.0.93 () {60 vars in 1342 bytes} [Wed May 11 19:05:33 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:33.724260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:33.725233 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:33.734638 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.736293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.737520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.737962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.771076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:05:33.881239 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d9f9fd32-2163-4a51-89b1-d059b9b4855e tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 204 len: 0 microversion: 2.20 time: 0.162842 May 11 19:05:33.881837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 557/1095] 10.222.0.93 () {60 vars in 1279 bytes} [Wed May 11 19:05:33 2022] DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 19:05:33.890722 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:33.891901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:33.897948 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.898383 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.899159 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.899793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.909812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:33.910648 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:33.917252 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.917718 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.918516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.919061 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.970381 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:33.970854 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:33.971481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lazy-loading 'fault' on Instance uuid b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:34.024631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:34.033284 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-984618c7-91e2-4359-93b3-889c5346370c tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1327 microversion: 2.1 time: 0.127653 May 11 19:05:34.033886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 558/1096] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:33 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:05:34.053918 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:34.063466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:34.065039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:34.066558 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1bda3564-4d7c-4a9d-8565-aaca5af5951f tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.180304 May 11 19:05:34.067215 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 539/1097] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:33 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:05:35.051199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:35.053041 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:35.060896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:35.061666 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:35.062966 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:35.062966 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:35.086532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:35.087249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:35.096142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:35.096962 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:35.098543 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:35.099281 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:35.110687 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:35.111138 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:35.111628 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lazy-loading 'fault' on Instance uuid b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:35.157539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8edf1e5f81c4e81b346c82cb48a47f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ad10e77d194397ba6a84cf39758839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:35.165199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3bc8294f-6391-4b99-9049-74593e8667dc tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 200 len: 1327 microversion: 2.1 time: 0.118229 May 11 19:05:35.165893 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 559/1098] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:35 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:35.246730 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:35.254422 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:35.255956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:35.257109 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2782a895-78b2-43de-ba1f-48455d17c106 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.175408 May 11 19:05:35.257677 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 540/1099] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:35 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 19:05:36.182049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:36.182662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:36.196809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:36.197482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:36.198283 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:36.198728 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:36.218109 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] HTTP exception thrown: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Request method failure captured: May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c HTTP/1.1 May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc3Yfhe0AXgI6ErlqsuDXPIkM7LBYPVG1rTelMv_GjO-DZ446j51Rq8MfL54ouYIOmu-nCgv84NB3a9xm4eKWvy1gh6FwMDBrhfbBOAg70GrrDXqIDkKkH6n_WfgmRuqXQRVTkuFIfCzQOL2Yle9Y9T35e4oblJ4-sUzX_WU2r4dmU May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:36.220557 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_35ad10e77d194397ba6a84cf39758839", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f8edf1e5f81c4e81b346c82cb48a47f6 May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:36.221970 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c'} May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:36.223223 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:36.225357 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:36.232215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Returning 404 to user: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:36.232215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c903036a-a58c-4069-bcbb-82340f807ded tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 404 len: 111 microversion: 2.1 time: 0.043912 May 11 19:05:36.232215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 560/1100] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:36 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:36.233081 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c5579c16-25cb-4307-be97-669d553f39b6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '.version_select at 0x7fa78752c1f0>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:36.261209 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c5579c16-25cb-4307-be97-669d553f39b6 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-447422281" status: 202 len: 0 microversion: 2.1 time: 0.033924 May 11 19:05:36.262468 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 541/1101] 10.222.0.93 () {58 vars in 1217 bytes} [Wed May 11 19:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-447422281 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 19:05:36.276708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:36.277520 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:36.284152 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:36.285067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:36.285898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:36.286339 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:36.566528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:36.581373 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:36.583519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:36.584700 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d5e614c4-6ea2-49ce-a390-fafe7de32f42 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1723 microversion: 2.20 time: 0.312775 May 11 19:05:36.585660 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 561/1102] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:36 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:05:37.614443 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:37.615324 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:37.623885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:37.624650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:37.625731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:37.627036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:37.696836 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-a5f9481d-0d5b-4bf0-8261-10c53c5a852c req-5dd64cbd-37ad-45c4-bca6-2b555ff25163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7eaafe-a747-46df-a1f1-c43cbe88e720", "name": "network-vif-deleted", "tag": "4835742f-ec35-4b97-b6e6-227ad8b350fb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:37.717874 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-a5f9481d-0d5b-4bf0-8261-10c53c5a852c req-5dd64cbd-37ad-45c4-bca6-2b555ff25163 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:37.718816 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-a5f9481d-0d5b-4bf0-8261-10c53c5a852c req-5dd64cbd-37ad-45c4-bca6-2b555ff25163 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:37.758986 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-a5f9481d-0d5b-4bf0-8261-10c53c5a852c req-5dd64cbd-37ad-45c4-bca6-2b555ff25163 service nova] Creating event network-vif-deleted:4835742f-ec35-4b97-b6e6-227ad8b350fb for instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 on hv-cinder-75510 May 11 19:05:37.772034 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:37.773788 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-a5f9481d-0d5b-4bf0-8261-10c53c5a852c req-5dd64cbd-37ad-45c4-bca6-2b555ff25163 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086329 May 11 19:05:37.774899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 562/1103] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:37.783644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:37.792893 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '378aab35909343d88c0250493e41be34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2d6a4c01b04940b13d9f1ca40bd778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:37.794561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5692eeff-0789-4449-ad7d-1f56f3c3876a tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 200 len: 1656 microversion: 2.20 time: 0.186533 May 11 19:05:37.798742 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 542/1104] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:37 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 1656 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 19:05:38.701983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:38.701983 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:38.712121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:38.712591 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:38.714804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:38.715258 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:38.781619 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:05:38.817085 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:38.817713 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:38.824919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:38.825653 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:38.826701 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:38.827514 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:38.845537 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] HTTP exception thrown: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Request method failure captured: May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 HTTP/1.1 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcoB2-4OF7shp-U2O-3E_zx_ot9bp4I5M2luUHJHE-6uWS4VH--IYvgFwTuAldpdLfjYziajlFngOQKBAW_2fq44jN8nyT8koNiwCrqOGweUziMz8vnScbUyyzBMaEY0krLj8um6pqbcjTS5i5-lMMWbMaifxW3iXAfxdZzJSzApRQ May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Openstack-Nova-Api-Version: 2.20 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:38.847857 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9e2d6a4c01b04940b13d9f1ca40bd778", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 378aab35909343d88c0250493e41be34 May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:38.849501 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'fe7eaafe-a747-46df-a1f1-c43cbe88e720'} May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:38.850297 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:38.851799 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:38.854162 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Returning 404 to user: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:38.854162 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-638818f1-b655-4f6e-ac05-1d4c64b60842 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 404 len: 111 microversion: 2.20 time: 0.037146 May 11 19:05:38.854162 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 543/1105] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:38 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 19:05:38.858897 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-0e7250e7-e2ac-410d-b08f-0fde7451a4e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '.version_select at 0x7fa787505940>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:38.878405 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-0e7250e7-e2ac-410d-b08f-0fde7451a4e9 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620339233" status: 204 len: 0 microversion: 2.20 time: 0.023823 May 11 19:05:38.878983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 544/1106] 10.222.0.93 () {60 vars in 1261 bytes} [Wed May 11 19:05:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620339233 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 19:05:38.888215 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-65782529-46ee-4262-b370-627abef588e8 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "DELETE /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 204 len: 0 microversion: 2.1 time: 0.190423 May 11 19:05:38.888938 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 563/1107] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:38 2022] DELETE /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:05:38.897026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:38.897634 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:38.904269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:38.904714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:38.905486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:38.905918 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:39.350609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:39.358984 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bde3fa8f-3f8a-4b65-ac9d-b9095a245c05 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.465719 May 11 19:05:39.359597 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 545/1108] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:38 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:39.507051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:39.507767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:39.514057 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:39.514601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:39.515489 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:39.515998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:39.530555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] HTTP exception thrown: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Request method failure captured: May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c HTTP/1.1 May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc3Yfhe0AXgI6ErlqsuDXPIkM7LBYPVG1rTelMv_GjO-DZ446j51Rq8MfL54ouYIOmu-nCgv84NB3a9xm4eKWvy1gh6FwMDBrhfbBOAg70GrrDXqIDkKkH6n_WfgmRuqXQRVTkuFIfCzQOL2Yle9Y9T35e4oblJ4-sUzX_WU2r4dmU May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:39.532497 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_35ad10e77d194397ba6a84cf39758839", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f8edf1e5f81c4e81b346c82cb48a47f6 May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.533821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c'} May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:39.538440 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.539756 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:39.540999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Returning 404 to user: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:39.540999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4a7001a6-3106-4a49-8b95-4c12baece817 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 404 len: 111 microversion: 2.1 time: 0.031181 May 11 19:05:39.540999 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 564/1109] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:39 2022] DELETE /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:39.542512 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:39.543127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:39.549606 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:39.550261 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:39.551029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:39.551663 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:39.566249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] HTTP exception thrown: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Request method failure captured: May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c HTTP/1.1 May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc3Yfhe0AXgI6ErlqsuDXPIkM7LBYPVG1rTelMv_GjO-DZ446j51Rq8MfL54ouYIOmu-nCgv84NB3a9xm4eKWvy1gh6FwMDBrhfbBOAg70GrrDXqIDkKkH6n_WfgmRuqXQRVTkuFIfCzQOL2Yle9Y9T35e4oblJ4-sUzX_WU2r4dmU May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:39.567898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_35ad10e77d194397ba6a84cf39758839", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f8edf1e5f81c4e81b346c82cb48a47f6 May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.569644 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c'} May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:39.570533 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. May 11 19:05:39.571982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:39.573700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Returning 404 to user: Instance b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:39.573700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3bbec21f-b7fe-451f-8705-bc5d918a8fed tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c" status: 404 len: 111 microversion: 2.1 time: 0.031049 May 11 19:05:39.573700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 546/1110] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:39 2022] GET /compute/v2.1/servers/b3ffb92f-8e13-4b4a-b398-6eb3ba1d3f2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:39.802071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-4213ac0a-6f55-43d2-9ccb-72acb0cb975d req-d9c5c4b0-1959-4d41-8281-121b3aa99eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:39.816084 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4213ac0a-6f55-43d2-9ccb-72acb0cb975d req-d9c5c4b0-1959-4d41-8281-121b3aa99eb4 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:39.816519 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4213ac0a-6f55-43d2-9ccb-72acb0cb975d req-d9c5c4b0-1959-4d41-8281-121b3aa99eb4 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:39.829224 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-4213ac0a-6f55-43d2-9ccb-72acb0cb975d req-d9c5c4b0-1959-4d41-8281-121b3aa99eb4 service nova] Creating event network-changed:c94167a9-9991-43a1-8fe8-7f90f0e5fd82 for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b on hv-cinder-75510 May 11 19:05:39.834388 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-4213ac0a-6f55-43d2-9ccb-72acb0cb975d req-d9c5c4b0-1959-4d41-8281-121b3aa99eb4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038378 May 11 19:05:39.835268 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 565/1111] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:40.379432 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:40.380037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:40.386406 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:40.386850 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:40.387633 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:40.388067 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:40.513168 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:40.520496 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7474090e-f6d9-48e1-b579-7a3e1bd87c9d tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.144992 May 11 19:05:40.521055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 547/1112] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:40 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:40.706631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:40.707207 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:40.713514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:40.713900 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:40.714655 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:40.715090 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:40.728042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] HTTP exception thrown: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Request method failure captured: May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 HTTP/1.1 May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAc3Yfhe0AXgI6ErlqsuDXPIkM7LBYPVG1rTelMv_GjO-DZ446j51Rq8MfL54ouYIOmu-nCgv84NB3a9xm4eKWvy1gh6FwMDBrhfbBOAg70GrrDXqIDkKkH6n_WfgmRuqXQRVTkuFIfCzQOL2Yle9Y9T35e4oblJ4-sUzX_WU2r4dmU May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:40.729688 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_35ad10e77d194397ba6a84cf39758839", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: f8edf1e5f81c4e81b346c82cb48a47f6 May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.731781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8'} May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:40.732630 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.733832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:40.735450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Returning 404 to user: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:40.735450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ca2265a5-df96-435e-89f1-6421f04d6723 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 404 len: 111 microversion: 2.1 time: 0.028616 May 11 19:05:40.735450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 566/1113] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:05:40 2022] DELETE /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:40.740025 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:40.740784 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] [instance: 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:40.746636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:40.747675 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:40.748463 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:40.748905 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:40.761719 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] HTTP exception thrown: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Request method failure captured: May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 HTTP/1.1 May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAc3Yfhe0AXgI6ErlqsuDXPIkM7LBYPVG1rTelMv_GjO-DZ446j51Rq8MfL54ouYIOmu-nCgv84NB3a9xm4eKWvy1gh6FwMDBrhfbBOAg70GrrDXqIDkKkH6n_WfgmRuqXQRVTkuFIfCzQOL2Yle9Y9T35e4oblJ4-sUzX_WU2r4dmU May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:40.763201 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_35ad10e77d194397ba6a84cf39758839", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/35ad10e77d194397ba6a84cf39758839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 35ad10e77d194397ba6a84cf39758839 May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1854070251 May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: f8edf1e5f81c4e81b346c82cb48a47f6 May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeTestJSON-1854070251-project May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.764793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8'} May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:40.765684 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. May 11 19:05:40.767142 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:40.768506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] Returning 404 to user: Instance 2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:40.768506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-83905712-0d55-4305-9b24-bd2d3e186c13 tempest-AttachVolumeTestJSON-1854070251 tempest-AttachVolumeTestJSON-1854070251-project] 10.222.0.93 "GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8" status: 404 len: 111 microversion: 2.1 time: 0.028466 May 11 19:05:40.768506 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 548/1114] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:40 2022] GET /compute/v2.1/servers/2f7f4cb9-fc8e-44e1-b944-d50d4f8fc2b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:41.537546 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:41.538290 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:41.544836 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:41.545281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:41.546042 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:41.546478 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:41.677347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:41.685556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-64335525-979d-477e-bd16-371724f6dd7e tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.151872 May 11 19:05:41.686161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 567/1115] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:41 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:42.705733 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:42.707539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:42.717753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:42.718227 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:42.719016 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:42.720505 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:42.943127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:42.951386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bfae8de2-4f66-44b5-8545-74213fb7cbd9 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1567 microversion: 2.1 time: 0.251392 May 11 19:05:42.953902 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 549/1116] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:42 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:43.973076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:43.973705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:43.979737 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:43.980409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:43.981347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:43.982074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:44.134429 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:44.145791 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-95b9581d-a8ff-46bd-bb7c-d81df1073a4b tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1448 microversion: 2.1 time: 0.178071 May 11 19:05:44.146466 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 568/1117] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:43 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:44.185641 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:44.186158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:44.192418 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:44.192877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:44.193917 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:44.194351 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:44.212158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] HTTP exception thrown: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Request method failure captured: May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 HTTP/1.1 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcoB2-4OF7shp-U2O-3E_zx_ot9bp4I5M2luUHJHE-6uWS4VH--IYvgFwTuAldpdLfjYziajlFngOQKBAW_2fq44jN8nyT8koNiwCrqOGweUziMz8vnScbUyyzBMaEY0krLj8um6pqbcjTS5i5-lMMWbMaifxW3iXAfxdZzJSzApRQ May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Openstack-Nova-Api-Version: 2.20 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:44.216457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9e2d6a4c01b04940b13d9f1ca40bd778", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 378aab35909343d88c0250493e41be34 May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.218060 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'fe7eaafe-a747-46df-a1f1-c43cbe88e720'} May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:44.218788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.220189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:44.224415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Returning 404 to user: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:44.225554 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-e14912e0-d570-44d8-a443-4fc898d88950 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 404 len: 111 microversion: 2.20 time: 0.044366 May 11 19:05:44.226375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 550/1118] 10.222.0.93 () {60 vars in 1279 bytes} [Wed May 11 19:05:44 2022] DELETE /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 19:05:44.234895 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:44.235540 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: fe7eaafe-a747-46df-a1f1-c43cbe88e720] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:44.244812 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:44.245269 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:44.246045 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:44.246502 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:44.268492 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] HTTP exception thrown: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Request method failure captured: May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 HTTP/1.1 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcoB2-4OF7shp-U2O-3E_zx_ot9bp4I5M2luUHJHE-6uWS4VH--IYvgFwTuAldpdLfjYziajlFngOQKBAW_2fq44jN8nyT8koNiwCrqOGweUziMz8vnScbUyyzBMaEY0krLj8um6pqbcjTS5i5-lMMWbMaifxW3iXAfxdZzJSzApRQ May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Openstack-Nova-Api-Version: 2.20 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:44.270960 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9e2d6a4c01b04940b13d9f1ca40bd778", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 378aab35909343d88c0250493e41be34 May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.272529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'fe7eaafe-a747-46df-a1f1-c43cbe88e720'} May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:44.273509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. May 11 19:05:44.274958 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:44.277378 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Returning 404 to user: Instance fe7eaafe-a747-46df-a1f1-c43cbe88e720 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:44.278642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-62aeb3ba-d692-4f24-b0d9-7c44dc9e86dc tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720" status: 404 len: 111 microversion: 2.20 time: 0.048133 May 11 19:05:44.279791 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 569/1119] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:44 2022] GET /compute/v2.1/servers/fe7eaafe-a747-46df-a1f1-c43cbe88e720 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 19:05:44.473256 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-046c3077-e7dd-4419-a953-711d91319395 req-cea24dfb-9126-4c60-9606-8007ef5d40ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217567c2-6dbb-4561-ad6e-4aa5229b474b", "name": "network-vif-deleted", "tag": "c94167a9-9991-43a1-8fe8-7f90f0e5fd82"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:05:44.489216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-046c3077-e7dd-4419-a953-711d91319395 req-cea24dfb-9126-4c60-9606-8007ef5d40ea service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:44.490054 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-046c3077-e7dd-4419-a953-711d91319395 req-cea24dfb-9126-4c60-9606-8007ef5d40ea service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:44.504295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-046c3077-e7dd-4419-a953-711d91319395 req-cea24dfb-9126-4c60-9606-8007ef5d40ea service nova] Creating event network-vif-deleted:c94167a9-9991-43a1-8fe8-7f90f0e5fd82 for instance 217567c2-6dbb-4561-ad6e-4aa5229b474b on hv-cinder-75510 May 11 19:05:44.509565 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-046c3077-e7dd-4419-a953-711d91319395 req-cea24dfb-9126-4c60-9606-8007ef5d40ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040191 May 11 19:05:44.512056 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 551/1120] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:05:45.162011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:45.162616 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:45.169722 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:45.170273 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:45.171142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:45.171633 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:45.235028 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:45.242550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6f373c37-9ab3-404f-8c0a-711e7d069151 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1219 microversion: 2.1 time: 0.084496 May 11 19:05:45.243119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 570/1121] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:45 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:46.260885 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:46.261589 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:46.268420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:46.268730 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:46.269499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:46.269933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:46.331147 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:46.338504 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c9bd544f-7483-471e-82c3-dc3c3892bb81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1219 microversion: 2.1 time: 0.082386 May 11 19:05:46.339072 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 552/1122] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:46 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:47.356125 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:47.356743 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:47.362611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:47.363068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:47.363865 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:47.364307 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:47.425212 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:47.433035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fc97fb15-61f9-41f3-9e10-88dcb3d1660c tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1219 microversion: 2.1 time: 0.080939 May 11 19:05:47.433597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 571/1123] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:47 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:48.450203 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:48.451670 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:48.464770 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.465776 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.466561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.467003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.498846 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.499559 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.500137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lazy-loading 'fault' on Instance uuid 217567c2-6dbb-4561-ad6e-4aa5229b474b {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:05:48.545299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521ce300deaf4ebba282688e5b8fa394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1d877d09894265a3ecb65f70684a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:05:48.553723 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-5e193c51-be45-40a3-9228-8d517a36933a tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 200 len: 1224 microversion: 2.1 time: 0.107413 May 11 19:05:48.554317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 553/1124] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:48 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:05:48.692419 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:48.692926 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:48.699386 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.700327 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.701131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.701565 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.716104 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] HTTP exception thrown: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Request method failure captured: May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd HTTP/1.1 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAcoB2-4OF7shp-U2O-3E_zx_ot9bp4I5M2luUHJHE-6uWS4VH--IYvgFwTuAldpdLfjYziajlFngOQKBAW_2fq44jN8nyT8koNiwCrqOGweUziMz8vnScbUyyzBMaEY0krLj8um6pqbcjTS5i5-lMMWbMaifxW3iXAfxdZzJSzApRQ May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Openstack-Nova-Api-Version: 2.20 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:48.717707 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9e2d6a4c01b04940b13d9f1ca40bd778", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 378aab35909343d88c0250493e41be34 May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.719453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '03cc433d-eca3-41fe-9a3a-45e94cd562fd'} May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:48.720501 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.722022 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:48.723601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Returning 404 to user: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:48.723601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1860c1b8-2c29-481e-819c-00e513906644 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 404 len: 111 microversion: 2.20 time: 0.030548 May 11 19:05:48.723601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 572/1125] 10.222.0.93 () {60 vars in 1279 bytes} [Wed May 11 19:05:48 2022] DELETE /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 19:05:48.727728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:48.728340 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] [instance: 03cc433d-eca3-41fe-9a3a-45e94cd562fd] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:48.734278 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.734729 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.735519 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:48.735956 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:48.748816 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] HTTP exception thrown: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Request method failure captured: May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd HTTP/1.1 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAcoB2-4OF7shp-U2O-3E_zx_ot9bp4I5M2luUHJHE-6uWS4VH--IYvgFwTuAldpdLfjYziajlFngOQKBAW_2fq44jN8nyT8koNiwCrqOGweUziMz8vnScbUyyzBMaEY0krLj8um6pqbcjTS5i5-lMMWbMaifxW3iXAfxdZzJSzApRQ May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Openstack-Nova-Api-Version: 2.20 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:05:48.750421 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9e2d6a4c01b04940b13d9f1ca40bd778", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9e2d6a4c01b04940b13d9f1ca40bd778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 9e2d6a4c01b04940b13d9f1ca40bd778 May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987188476 May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 378aab35909343d88c0250493e41be34 May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987188476-project May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.752090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '03cc433d-eca3-41fe-9a3a-45e94cd562fd'} May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:48.752961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. May 11 19:05:48.754388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:05:48.755712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] Returning 404 to user: Instance 03cc433d-eca3-41fe-9a3a-45e94cd562fd could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:48.755712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f36285fb-26b3-433d-93d0-6108ea522466 tempest-AttachVolumeShelveTestJSON-1987188476 tempest-AttachVolumeShelveTestJSON-1987188476-project] 10.222.0.93 "GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd" status: 404 len: 111 microversion: 2.20 time: 0.028069 May 11 19:05:48.755712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 554/1126] 10.222.0.93 () {60 vars in 1276 bytes} [Wed May 11 19:05:48 2022] GET /compute/v2.1/servers/03cc433d-eca3-41fe-9a3a-45e94cd562fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 19:05:49.570843 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:49.571391 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] [instance: 217567c2-6dbb-4561-ad6e-4aa5229b474b] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:05:49.577612 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:49.578134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:49.578913 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:05:49.579450 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:05:49.593293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] HTTP exception thrown: Instance 217567c2-6dbb-4561-ad6e-4aa5229b474b could not be found. May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Request method failure captured: May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b HTTP/1.1 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAeIz4EKNNqP2yQCFbkn_hIqkJ89eQqL9ZUgcMp9brI2g_dsILRnntZt7Adnu3ELAMCc5jpAMLldxZb3V_kYEcEvUuBH4SBKugMPMV0dO_5JDKySJ3pi1rac9KWgFp5bZOzGALGhnMZ8iUnCjdLYOOx01zy0d11w-1XXswstTxI1v08 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 7d1d877d09894265a3ecb65f70684a29 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-TestShelveInstance-1703536219 May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:05:49.594979 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7d1d877d09894265a3ecb65f70684a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7d1d877d09894265a3ecb65f70684a29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7d1d877d09894265a3ecb65f70684a29", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7d1d877d09894265a3ecb65f70684a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-TestShelveInstance-1703536219 May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 7d1d877d09894265a3ecb65f70684a29 May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-TestShelveInstance-1703536219 May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-TestShelveInstance-1703536219-project May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 521ce300deaf4ebba282688e5b8fa394 May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-TestShelveInstance-1703536219-project May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 217567c2-6dbb-4561-ad6e-4aa5229b474b could not be found. May 11 19:05:49.596595 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '217567c2-6dbb-4561-ad6e-4aa5229b474b'} May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217567c2-6dbb-4561-ad6e-4aa5229b474b could not be found. May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:05:49.597430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217567c2-6dbb-4561-ad6e-4aa5229b474b could not be found. May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217567c2-6dbb-4561-ad6e-4aa5229b474b could not be found. May 11 19:05:49.598686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:05:49.600046 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Returning 404 to user: Instance 217567c2-6dbb-4561-ad6e-4aa5229b474b could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:05:49.600046 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f349d85f-e4f6-4f90-9925-a5b22fb8fa81 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b" status: 404 len: 111 microversion: 2.1 time: 0.029796 May 11 19:05:49.600046 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 573/1127] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:05:49 2022] GET /compute/v2.1/servers/217567c2-6dbb-4561-ad6e-4aa5229b474b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:05:49.766137 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-d1bb0efd-aa66-4123-bd7d-0206d50e8561 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] Calling method '.version_select at 0x7fa787505700>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:05:49.791696 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-d1bb0efd-aa66-4123-bd7d-0206d50e8561 tempest-TestShelveInstance-1703536219 tempest-TestShelveInstance-1703536219-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203305523" status: 202 len: 0 microversion: 2.1 time: 0.029760 May 11 19:05:49.796855 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 555/1128] 10.222.0.93 () {58 vars in 1250 bytes} [Wed May 11 19:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203305523 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:06:36.895992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-27614465", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "networks": [{"uuid": "373744b8-6035-4169-bba7-c1e6c9710228"}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:06:36.947957 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] validate_networks() for [('373744b8-6035-4169-bba7-c1e6c9710228', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:06:37.308111 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:06:37.308536 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:06:37.309012 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:06:37.309420 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:06:37.309831 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:06:37.320275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:37.320729 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:37.321527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:37.321967 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:37.339183 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Getting quotas for project 6d43929ef2a74d3fb50580db2b83d868. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:06:37.343229 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Getting quotas for user 36dbb1e903f24becaede7f26b06845e8 and project 6d43929ef2a74d3fb50580db2b83d868. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:06:37.355611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:06:37.358385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:06:37.408528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e1bae23c-5666-41f6-b8c1-3bfa4cc9ff8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516163 May 11 19:06:37.409360 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 574/1129] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:06:37.420258 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ecbad808-cf80-4ee8-95b3-b2ca177ff09a tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:37.420845 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ecbad808-cf80-4ee8-95b3-b2ca177ff09a tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:37.501425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ecbad808-cf80-4ee8-95b3-b2ca177ff09a tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:37.508616 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ecbad808-cf80-4ee8-95b3-b2ca177ff09a tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1217 microversion: 2.1 time: 0.092876 May 11 19:06:37.509532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 556/1130] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:37 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:38.526705 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:38.527344 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:38.533336 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:38.533787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:38.534556 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:38.534992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:38.606886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:38.620538 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-2f64f507-a069-404f-b54b-e3a4e414fd2e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1277 microversion: 2.1 time: 0.098255 May 11 19:06:38.621555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 575/1131] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:38 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:39.638057 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:39.639181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:39.645724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:39.646318 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:39.647113 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:39.647604 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:39.867372 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:39.875859 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6db6fa49-224d-4777-a9e8-61e2bc1a8d3f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1317 microversion: 2.1 time: 0.241654 May 11 19:06:39.876672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 557/1132] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:39 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:40.276989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-da11fec4-301a-459d-81f8-36adfced81fd req-53c65b50-c637-4d6d-af0a-d8f2fcadefe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9", "tag": "4d2c8192-f5d6-4d49-b0d3-7c01517904eb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:06:40.286758 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-da11fec4-301a-459d-81f8-36adfced81fd req-53c65b50-c637-4d6d-af0a-d8f2fcadefe5 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:40.287206 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-da11fec4-301a-459d-81f8-36adfced81fd req-53c65b50-c637-4d6d-af0a-d8f2fcadefe5 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:40.298481 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-da11fec4-301a-459d-81f8-36adfced81fd req-53c65b50-c637-4d6d-af0a-d8f2fcadefe5 service nova] Creating event network-changed:4d2c8192-f5d6-4d49-b0d3-7c01517904eb for instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 on hv-cinder-75510 May 11 19:06:40.303409 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-da11fec4-301a-459d-81f8-36adfced81fd req-53c65b50-c637-4d6d-af0a-d8f2fcadefe5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029997 May 11 19:06:40.304313 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 576/1133] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:06:40.897090 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:40.897732 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:40.904546 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:40.904998 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:40.905769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:40.906208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:41.044420 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:41.053158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-71e8ee63-fc52-42bb-95d1-db569b1942fd tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1317 microversion: 2.1 time: 0.159924 May 11 19:06:41.053736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 558/1134] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:40 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:42.071685 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:42.072380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:42.078717 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:42.079220 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:42.080053 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:42.080484 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:42.215905 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:42.224581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-3857ec88-7469-430a-bad5-203aa66b54a2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1317 microversion: 2.1 time: 0.157799 May 11 19:06:42.225157 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 577/1135] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:42 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:43.241699 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:43.242322 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:43.248931 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:43.249386 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:43.250164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:43.250608 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:43.399976 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:43.407531 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-66a62784-dbef-4bc1-afad-3c683dd41ff7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1317 microversion: 2.1 time: 0.169912 May 11 19:06:43.408094 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 559/1136] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:43 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:44.424170 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:44.424787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:44.431131 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:44.431611 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:44.432380 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:44.432817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:44.562470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:44.569991 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-443e1d11-172a-4008-9f29-dae98cd0a6cf tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1317 microversion: 2.1 time: 0.149753 May 11 19:06:44.570551 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 578/1137] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:44 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:44.834190 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-ada79796-72cd-48a6-86f2-40fcf072a254 req-6eca28bd-2c55-45d6-97c9-2c33e71c81ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9", "name": "network-vif-plugged", "status": "completed", "tag": "4d2c8192-f5d6-4d49-b0d3-7c01517904eb"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:06:44.842756 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-ada79796-72cd-48a6-86f2-40fcf072a254 req-6eca28bd-2c55-45d6-97c9-2c33e71c81ed service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:44.843253 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-ada79796-72cd-48a6-86f2-40fcf072a254 req-6eca28bd-2c55-45d6-97c9-2c33e71c81ed service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:44.854727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-ada79796-72cd-48a6-86f2-40fcf072a254 req-6eca28bd-2c55-45d6-97c9-2c33e71c81ed service nova] Creating event network-vif-plugged:4d2c8192-f5d6-4d49-b0d3-7c01517904eb for instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 on hv-cinder-75510 May 11 19:06:44.860211 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-ada79796-72cd-48a6-86f2-40fcf072a254 req-6eca28bd-2c55-45d6-97c9-2c33e71c81ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029675 May 11 19:06:44.861009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 560/1138] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:06:45.587686 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:45.588322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:45.595368 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:45.595818 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:45.596587 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:45.597024 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:45.723007 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:45.730304 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-134d6d7f-5745-4f60-b7ed-ffde2146b9ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1317 microversion: 2.1 time: 0.146833 May 11 19:06:45.730866 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 579/1139] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:45 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:06:46.748247 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:06:46.748945 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:06:46.755382 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:46.755615 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:46.756416 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:06:46.756877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:06:46.886600 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:06:46.894703 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-06b1dc79-b359-4d93-8906-ac776603da8f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1506 microversion: 2.1 time: 0.151820 May 11 19:06:46.895146 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 561/1140] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:06:46 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:05.141801 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce461b5d-295e-4017-93ec-846f35dfa334", "device": "/dev/sdb"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:05.143456 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:05.149482 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:05.149957 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:05.150719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:05.151154 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:05.409956 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-65df7526-46e4-4db9-ae48-e8cd37b88e3c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "POST /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271941 May 11 19:07:05.410558 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 580/1141] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:07:05 2022] POST /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:07:29.159786 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:29.160302 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:29.166356 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:29.166807 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:29.167605 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:29.168044 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:29.247104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lazy-loading 'services' on Instance uuid 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:07:29.316310 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-75930234-452d-4bcb-bdaf-e6ae46755dc6 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9/os-volume_attachments/ce461b5d-295e-4017-93ec-846f35dfa334" status: 202 len: 0 microversion: 2.1 time: 0.160878 May 11 19:07:29.316915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 562/1142] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:07:29 2022] DELETE /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9/os-volume_attachments/ce461b5d-295e-4017-93ec-846f35dfa334 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:07:30.428243 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:30.428837 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:30.434918 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:30.435417 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:30.436191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:30.436631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:30.461652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:07:30.533832 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-e2cf19d6-f4d2-481c-98da-425f43565f4b tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 204 len: 0 microversion: 2.1 time: 0.110083 May 11 19:07:30.534424 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 581/1143] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:07:30 2022] DELETE /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:07:30.543996 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:30.544726 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:30.551049 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:30.551529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:30.552299 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:30.552734 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:30.678790 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:30.686052 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-25271027-287b-432a-8bd2-6adba6ba5db2 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1512 microversion: 2.1 time: 0.146825 May 11 19:07:30.686617 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 563/1144] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:30 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:31.704398 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:31.705101 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:31.711475 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:31.711930 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:31.712695 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:31.713134 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:31.841054 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:31.850249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-427c903f-854e-4c97-af03-d171240adec7 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1512 microversion: 2.1 time: 0.149459 May 11 19:07:31.850992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 582/1145] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:31 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:32.874037 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:32.874683 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:32.881757 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-0901b9f4-17d7-48cf-8b5e-b4faa253586a req-9fa463d1-a6c6-4f1b-89ec-2144bfa172b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9", "name": "network-vif-deleted", "tag": "4d2c8192-f5d6-4d49-b0d3-7c01517904eb"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:32.882295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:32.882648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:32.883525 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:32.884046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:32.890509 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-0901b9f4-17d7-48cf-8b5e-b4faa253586a req-9fa463d1-a6c6-4f1b-89ec-2144bfa172b0 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:32.890962 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-0901b9f4-17d7-48cf-8b5e-b4faa253586a req-9fa463d1-a6c6-4f1b-89ec-2144bfa172b0 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:32.902751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-0901b9f4-17d7-48cf-8b5e-b4faa253586a req-9fa463d1-a6c6-4f1b-89ec-2144bfa172b0 service nova] Creating event network-vif-deleted:4d2c8192-f5d6-4d49-b0d3-7c01517904eb for instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 on hv-cinder-75510 May 11 19:07:32.907715 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-0901b9f4-17d7-48cf-8b5e-b4faa253586a req-9fa463d1-a6c6-4f1b-89ec-2144bfa172b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030070 May 11 19:07:32.908560 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 583/1146] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:07:32.950712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:32.959202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7b38840f-2dec-42b2-b91f-e9336239c5c9 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 200 len: 1470 microversion: 2.1 time: 0.089134 May 11 19:07:32.960028 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 564/1147] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:32 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 1470 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:33.977167 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:33.977868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:33.984068 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:33.984529 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:33.985297 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:33.985739 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:33.998855 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] HTTP exception thrown: Instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 could not be found. May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Request method failure captured: May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 HTTP/1.1 May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAk7mD6iFgl7I9bvwEuc7cbHU4DvGto7TvoIkuLhaPOKojfOH9a_e-sNM3Sq45uaN2mJ54501WSE-mJFwPT5urwatO5iIpxQNCYxt1RwJyd98OjgGaXOlk5y5U2FFmyon--kj2FI6iwl6AuPXG8wmyq_CB8oVO7wGYEMUqmHHgHSbNs May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: 6d43929ef2a74d3fb50580db2b83d868 May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-VolumesSnapshotTestJSON-986153274 May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:07:34.000470 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6d43929ef2a74d3fb50580db2b83d868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d43929ef2a74d3fb50580db2b83d868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6d43929ef2a74d3fb50580db2b83d868", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d43929ef2a74d3fb50580db2b83d868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-VolumesSnapshotTestJSON-986153274 May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: 6d43929ef2a74d3fb50580db2b83d868 May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-986153274 May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-VolumesSnapshotTestJSON-986153274-project May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: 36dbb1e903f24becaede7f26b06845e8 May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-VolumesSnapshotTestJSON-986153274-project May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 could not be found. May 11 19:07:34.002159 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9'} May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 could not be found. May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:07:34.003194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 could not be found. May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 could not be found. May 11 19:07:34.004549 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:34.005709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Returning 404 to user: Instance 2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:07:34.005709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-6e273c1e-f9ad-45a7-943f-10acce31c3c0 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9" status: 404 len: 111 microversion: 2.1 time: 0.029439 May 11 19:07:34.005709 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 584/1148] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:33 2022] GET /compute/v2.1/servers/2c62a7d8-8127-4284-a8cb-ffc1d0a57ab9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:07:42.667030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:42.667628 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:42.674086 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:42.674536 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:42.675321 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:42.675767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:42.702841 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:07:42.782621 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-6ab048b3-ef59-4c73-8819-7892b9d75b2b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 204 len: 0 microversion: 2.1 time: 0.119123 May 11 19:07:42.783650 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 565/1149] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:07:42 2022] DELETE /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:07:42.791971 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:42.792675 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:42.799351 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:42.799809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:42.800644 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:42.801088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:42.808957 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1557314397", "imageRef": "263f065c-18af-4c6b-b95c-9108b261ebbe", "flavorRef": "452", "networks": [{"uuid": "373744b8-6035-4169-bba7-c1e6c9710228"}]}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:43.012609 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] validate_networks() for [('373744b8-6035-4169-bba7-c1e6c9710228', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:07:43.083703 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:43.091062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1cc20269-f784-4812-97a9-a99d811165e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1578 microversion: 2.1 time: 0.303070 May 11 19:07:43.091662 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 585/1150] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:42 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1578 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:43.344273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:07:43.344731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:07:43.345212 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:07:43.345624 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:07:43.346529 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:07:43.355083 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:43.355567 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:43.356388 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:43.356814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:43.373363 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Getting quotas for project 6d43929ef2a74d3fb50580db2b83d868. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:07:43.377256 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Getting quotas for user 36dbb1e903f24becaede7f26b06845e8 and project 6d43929ef2a74d3fb50580db2b83d868. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:07:43.387823 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:07:43.390129 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='263f065c-18af-4c6b-b95c-9108b261ebbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:07:43.433868 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-eeb4393d-f950-4e63-abb0-4f42d889b106 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629263 May 11 19:07:43.434510 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 566/1151] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 19:07:43.444539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5f3dc678-1d09-4c0f-95d2-3df8287c0229 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:43.445149 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5f3dc678-1d09-4c0f-95d2-3df8287c0229 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:43.501441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5f3dc678-1d09-4c0f-95d2-3df8287c0229 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:43.508067 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5f3dc678-1d09-4c0f-95d2-3df8287c0229 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1219 microversion: 2.1 time: 0.067463 May 11 19:07:43.508570 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 586/1152] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:43 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:44.109102 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:44.109661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:44.115727 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:44.116176 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:44.116939 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:44.117379 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:44.253202 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:44.260598 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ef6ba964-6176-4b71-b1a5-654985e4f2d7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1578 microversion: 2.1 time: 0.155978 May 11 19:07:44.261163 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 567/1153] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:44 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:44.524750 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:44.525363 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:44.532433 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:44.532887 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:44.533657 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:44.534096 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:44.593992 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:44.601439 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-dcb32ad5-a541-4e32-b7ad-565c06097b8e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1271 microversion: 2.1 time: 0.080613 May 11 19:07:44.602005 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 587/1154] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:44 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:45.278568 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:45.279178 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:45.286210 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:45.286668 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:45.287725 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:45.288168 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:45.379056 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:45.390389 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cd5d55c1-6ea8-49eb-b59c-e9eb59ec20c3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1511 microversion: 2.1 time: 0.115708 May 11 19:07:45.391544 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 568/1155] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:45 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1511 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:45.620260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:45.621498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:45.633890 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:45.635275 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:45.636338 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:45.637394 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:45.687932 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-e99f0dec-8a84-4443-aa11-5682ca7c465a req-5d1ed346-4e42-4f35-8340-82e463b0adfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ffc6c7-d651-46de-871e-3ad46ec97a88", "name": "network-vif-deleted", "tag": "d0ac5c5d-fe7d-4831-954a-d5bee6c73eec"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:45.709814 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-e99f0dec-8a84-4443-aa11-5682ca7c465a req-5d1ed346-4e42-4f35-8340-82e463b0adfc service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:45.710572 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-e99f0dec-8a84-4443-aa11-5682ca7c465a req-5d1ed346-4e42-4f35-8340-82e463b0adfc service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:45.743764 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-e99f0dec-8a84-4443-aa11-5682ca7c465a req-5d1ed346-4e42-4f35-8340-82e463b0adfc service nova] Creating event network-vif-deleted:d0ac5c5d-fe7d-4831-954a-d5bee6c73eec for instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 on hv-cinder-75510 May 11 19:07:45.752088 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-e99f0dec-8a84-4443-aa11-5682ca7c465a req-5d1ed346-4e42-4f35-8340-82e463b0adfc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070314 May 11 19:07:45.760523 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 569/1156] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:07:45.914063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:45.922798 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-faeeb48a-5f9c-4986-8daf-78cb734ef07f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.308674 May 11 19:07:45.924143 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 588/1157] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:45 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:46.268557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-7cc6d34b-bfd7-49d2-8775-ea6f20f8a61b req-40515732-dc36-4804-a25c-ebeb517583d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55dbec2-5811-4945-898b-df01b351d4ea", "tag": "64b8c25a-5f35-40db-90d5-a821ebeffe1e"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:46.277489 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7cc6d34b-bfd7-49d2-8775-ea6f20f8a61b req-40515732-dc36-4804-a25c-ebeb517583d2 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:46.278093 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7cc6d34b-bfd7-49d2-8775-ea6f20f8a61b req-40515732-dc36-4804-a25c-ebeb517583d2 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:46.295521 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-7cc6d34b-bfd7-49d2-8775-ea6f20f8a61b req-40515732-dc36-4804-a25c-ebeb517583d2 service nova] Creating event network-changed:64b8c25a-5f35-40db-90d5-a821ebeffe1e for instance e55dbec2-5811-4945-898b-df01b351d4ea on hv-cinder-75510 May 11 19:07:46.300172 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-7cc6d34b-bfd7-49d2-8775-ea6f20f8a61b req-40515732-dc36-4804-a25c-ebeb517583d2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036253 May 11 19:07:46.300772 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 570/1158] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:07:46.408679 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:46.409579 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:46.417581 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:46.418390 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:46.419804 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:46.420653 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:46.455160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:46.456392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:46.457019 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.objects.instance [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lazy-loading 'fault' on Instance uuid d0ffc6c7-d651-46de-871e-3ad46ec97a88 {{(pid=117096) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:07:46.534265 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:46.541459 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-5b026a05-1f13-44d7-aac0-69c0cf2441b4 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 200 len: 1184 microversion: 2.1 time: 0.137091 May 11 19:07:46.542162 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 589/1159] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:46 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 1184 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:46.943503 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:46.944200 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:46.950431 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:46.950875 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:46.951665 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:46.952100 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:47.082323 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:47.090011 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-952a9409-9572-4d01-8ea9-76d0ff1c34ed tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.151945 May 11 19:07:47.090584 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 571/1160] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:46 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:47.558016 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:47.558574 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:47.565583 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:47.566033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:47.566792 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:47.567226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:47.580664 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] HTTP exception thrown: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Request method failure captured: May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 HTTP/1.1 May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAjFPL7D7BAh0kYTNyWss0F6wwVwgFVx-EUI2acj4ipyFbeMtGyynk0IVU7npJQ9RAXkXlrElGJSrq_9NzRrefGHBU2Xjoa1cicQ3znqGhi99HWPBe7cfeiNzDLTna5oqzXl_EIA4Te5Q9qXdG9Gi55vdogsNFiz4qAR0FFFTdL6T-w May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:07:47.582160 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aaad8f4e0e0b41c4b227a090b8260f61", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-TestVolumeBootPattern-1667792582 May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-TestVolumeBootPattern-1667792582-project May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: ead71051e3c548e7989007c8f5d0abc0 May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-TestVolumeBootPattern-1667792582-project May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:07:47.583805 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'd0ffc6c7-d651-46de-871e-3ad46ec97a88'} May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:07:47.584819 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:07:47.586211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:07:47.587500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Returning 404 to user: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:07:47.587500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4e180e41-093f-417e-a48d-f12f93e44488 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 404 len: 111 microversion: 2.1 time: 0.029524 May 11 19:07:47.587500 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 590/1161] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:47 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:07:47.679384 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-871162156", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1150264539", "security_groups": [{"name": "tempest-secgroup-smoke-809237043"}], "block_device_mapping_v2": [{"uuid": "37c6eb8b-8f70-421d-8ef3-5d1bf1fbd519", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3cca2bc-d77d-445f-bc7f-2c39c608cd4e"}]}} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:47.785497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.network.neutron [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] validate_networks() for [('f3cca2bc-d77d-445f-bc7f-2c39c608cd4e', None, None, None, None, None)] {{(pid=117097) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:07:48.107060 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:48.107714 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:48.114221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:48.114661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:48.115446 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:48.115876 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:48.140554 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Flavor limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:07:48.141056 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Image limits 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:07:48.141715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Flavor pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:07:48.142222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Image pref 0:0:0 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:07:48.142753 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.virt.hardware [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:07:48.151482 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:48.151927 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:48.152716 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:48.153149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:48.169970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:07:48.174345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.quota [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for user ead71051e3c548e7989007c8f5d0abc0 and project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'ram', 'instances', 'cores'} {{(pid=117097) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:07:48.230915 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Going to run 1 instances... {{(pid=117097) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:07:48.233036 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37c6eb8b-8f70-421d-8ef3-5d1bf1fbd519',volume_size=None,volume_type=None)] {{(pid=117097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:07:48.247348 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:48.255354 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-45b03596-9117-4cb7-96cc-988ec9e42954 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.152152 May 11 19:07:48.256190 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 591/1162] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:48 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:07:48.357408 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-cbfd1289-09b7-484d-8b30-1c76ba9ca9ff tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681823 May 11 19:07:48.358050 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 572/1163] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:07:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:07:48.368708 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1e2cc7c2-b7d4-4175-873f-6f197bb51fa7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:48.369347 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1e2cc7c2-b7d4-4175-873f-6f197bb51fa7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:48.424642 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1e2cc7c2-b7d4-4175-873f-6f197bb51fa7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:48.431103 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1e2cc7c2-b7d4-4175-873f-6f197bb51fa7 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1094 microversion: 2.1 time: 0.066455 May 11 19:07:48.431936 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 592/1164] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:48 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:49.271350 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:49.271970 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:49.278466 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:49.278919 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:49.279747 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:49.280167 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:49.417105 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:49.426415 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b1890b0b-327e-4315-8d9e-7291efe28f8c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.158967 May 11 19:07:49.426992 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 573/1165] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:49 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:49.448116 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:49.448736 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:49.460244 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:49.460640 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:49.461429 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:49.463795 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:49.550330 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:49.560064 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1ec00416-b2c0-4d71-9931-d61afb94ecbe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1200 microversion: 2.1 time: 0.116121 May 11 19:07:49.560735 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 593/1166] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:49 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1200 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:50.443781 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:50.444390 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:50.450961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:50.451434 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:50.452195 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:50.452624 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:50.577682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:50.578265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:50.578400 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:50.584769 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:50.585349 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:50.585528 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-18053e59-b1b4-46cf-a34d-c784e1a6a72c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.146289 May 11 19:07:50.586118 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 574/1167] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:50 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:50.586965 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:50.587568 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:50.791238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:50.798959 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-c6ab52c4-1b97-4f3e-a25a-8e0ba8cd4522 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.225323 May 11 19:07:50.800261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 594/1168] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:50 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:50.993012 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-f20266c0-c3b4-4c85-a6b1-f1d3c38ff6fd req-ae76129a-b099-430f-859b-6b0b13106ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703a0761-6018-4082-9de4-2dfdc3281996", "tag": "10f48d32-e534-425e-baeb-0f38e0869784"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:51.006667 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-f20266c0-c3b4-4c85-a6b1-f1d3c38ff6fd req-ae76129a-b099-430f-859b-6b0b13106ebb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:51.007240 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-f20266c0-c3b4-4c85-a6b1-f1d3c38ff6fd req-ae76129a-b099-430f-859b-6b0b13106ebb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:51.031346 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-f20266c0-c3b4-4c85-a6b1-f1d3c38ff6fd req-ae76129a-b099-430f-859b-6b0b13106ebb service nova] Creating event network-changed:10f48d32-e534-425e-baeb-0f38e0869784 for instance 703a0761-6018-4082-9de4-2dfdc3281996 on hv-cinder-75510 May 11 19:07:51.037579 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-f20266c0-c3b4-4c85-a6b1-f1d3c38ff6fd req-ae76129a-b099-430f-859b-6b0b13106ebb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051965 May 11 19:07:51.038912 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 575/1169] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:07:51.455910 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-c2a9687d-c8ee-459c-bd77-b83e39569a25 req-be1deff6-1c08-4e2b-8b9c-da743509e2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55dbec2-5811-4945-898b-df01b351d4ea", "name": "network-vif-plugged", "status": "completed", "tag": "64b8c25a-5f35-40db-90d5-a821ebeffe1e"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:51.468385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-c2a9687d-c8ee-459c-bd77-b83e39569a25 req-be1deff6-1c08-4e2b-8b9c-da743509e2fa service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:51.469238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-c2a9687d-c8ee-459c-bd77-b83e39569a25 req-be1deff6-1c08-4e2b-8b9c-da743509e2fa service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:51.485323 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-c2a9687d-c8ee-459c-bd77-b83e39569a25 req-be1deff6-1c08-4e2b-8b9c-da743509e2fa service nova] Creating event network-vif-plugged:64b8c25a-5f35-40db-90d5-a821ebeffe1e for instance e55dbec2-5811-4945-898b-df01b351d4ea on hv-cinder-75510 May 11 19:07:51.490914 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-c2a9687d-c8ee-459c-bd77-b83e39569a25 req-be1deff6-1c08-4e2b-8b9c-da743509e2fa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039539 May 11 19:07:51.491559 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 595/1170] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:07:51.602962 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:51.604295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:51.611472 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:51.612010 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:51.612789 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:51.613229 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:51.818187 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:51.818889 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:51.826062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:51.826522 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:51.827663 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:51.828105 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:51.964955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:51.973742 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7225a2f6-8852-4909-b996-80bb501d8eab tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.160293 May 11 19:07:51.974627 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 596/1171] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:51 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:07:52.043557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:52.051250 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-45f90f77-043c-45d9-bd5f-57a6f859e0ee tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.452377 May 11 19:07:52.051932 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 576/1172] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:51 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:52.991711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:52.992251 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:52.998545 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:52.999000 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:52.999800 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:53.000242 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:53.068751 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:53.069345 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:53.075895 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:53.076348 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:53.077129 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:53.077572 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:53.131158 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:53.138542 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-55b04bad-41f1-49dc-8d0b-439e025cdb85 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.150872 May 11 19:07:53.139121 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 597/1173] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:52 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:53.214709 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:53.222067 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-3314d19c-c448-4236-b8d3-c2b23eaf0e55 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1319 microversion: 2.1 time: 0.157723 May 11 19:07:53.222632 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 577/1174] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:53 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:07:54.155589 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:54.156189 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:54.162539 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:54.162988 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:54.163780 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:54.164218 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:54.238597 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:54.239635 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:54.245620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:54.246121 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:54.246891 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:54.247365 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:54.294751 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:54.302755 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-fc892964-87af-48d0-9eae-e5dd2c5816a6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.151061 May 11 19:07:54.303356 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 598/1175] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:54 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:54.374144 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:54.381978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b1fef4ae-3269-4429-92ed-03fa2190222c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1508 microversion: 2.1 time: 0.147834 May 11 19:07:54.382541 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 578/1176] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:54 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:07:54.397952 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2248b7a1-2d92-4d35-baf9-4834b6d10200", "device": "/dev/sdb"}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:07:54.399049 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:54.404871 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:54.405320 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:54.406142 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:54.406518 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:54.647873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8b016b25-9800-48d5-8bfa-b230c6c2dd4c tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "POST /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253689 May 11 19:07:54.648551 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 599/1177] 10.222.0.93 () {60 vars in 1322 bytes} [Wed May 11 19:07:54 2022] POST /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:07:55.319437 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:55.320044 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:55.326618 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:55.327068 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:55.327854 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:55.328292 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:55.462084 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:55.469636 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-f2e52988-794c-4c48-af41-1945f61af159 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.154048 May 11 19:07:55.470155 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 579/1178] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:55 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:56.487346 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:56.488033 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:56.494184 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:56.494624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:56.495410 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:56.495840 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:56.626403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:56.633757 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4874b039-1fe2-430f-ab0a-a710e480be36 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.151242 May 11 19:07:56.634331 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 600/1179] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:56 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:57.650837 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:57.651399 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:57.657759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:57.658700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:57.659495 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:57.659933 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:57.792181 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:57.800208 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-7c2ab39e-f640-483c-863e-3daf53f6b89f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.153363 May 11 19:07:57.800777 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 580/1180] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:57 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:58.817458 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:58.818102 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:58.824849 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:58.825302 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:58.826078 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:58.826515 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:58.954401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:07:58.961748 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-01e20f77-429a-4e12-a0ae-a97c1140df05 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.148799 May 11 19:07:58.962309 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 601/1181] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:58 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:07:59.977927 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:07:59.978690 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:07:59.985076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:59.985525 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:07:59.986288 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:07:59.986724 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:00.117771 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:00.125080 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-22896ebc-02b8-4a00-89ee-b95be296e2a9 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.151019 May 11 19:08:00.125647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 581/1182] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:07:59 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:01.142092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:01.143135 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:01.149426 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:01.149870 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:01.150626 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:01.151063 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:01.281308 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:01.288541 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-7b345f1d-15da-47c0-a1ae-4b652871486f tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.150491 May 11 19:08:01.289100 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 602/1183] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:01 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:01.544846 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-bd0be1a7-12c6-471d-8bfe-55315c4b33ab req-72d96b37-3421-42bf-af4d-6e58051c9c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703a0761-6018-4082-9de4-2dfdc3281996", "name": "network-vif-plugged", "status": "completed", "tag": "10f48d32-e534-425e-baeb-0f38e0869784"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:08:01.553671 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-bd0be1a7-12c6-471d-8bfe-55315c4b33ab req-72d96b37-3421-42bf-af4d-6e58051c9c36 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:01.554127 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-bd0be1a7-12c6-471d-8bfe-55315c4b33ab req-72d96b37-3421-42bf-af4d-6e58051c9c36 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:01.565778 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-bd0be1a7-12c6-471d-8bfe-55315c4b33ab req-72d96b37-3421-42bf-af4d-6e58051c9c36 service nova] Creating event network-vif-plugged:10f48d32-e534-425e-baeb-0f38e0869784 for instance 703a0761-6018-4082-9de4-2dfdc3281996 on hv-cinder-75510 May 11 19:08:01.570982 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-bd0be1a7-12c6-471d-8bfe-55315c4b33ab req-72d96b37-3421-42bf-af4d-6e58051c9c36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029609 May 11 19:08:01.571614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 582/1184] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:08:02.304079 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:02.304761 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:02.311032 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:02.311528 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:02.312293 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:02.312732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:02.438425 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:02.446601 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-13b65c1a-23af-4be5-9d31-5393c0074bed tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.146396 May 11 19:08:02.447161 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 603/1185] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:02 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:03.464213 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:03.464872 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:03.471707 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:03.472164 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:03.472934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:03.473376 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:03.603207 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:03.610595 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-13ecd4c0-75cc-42c9-b5fa-6675a249375c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.151167 May 11 19:08:03.611170 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 583/1186] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:03 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:04.628296 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:04.628847 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:04.635194 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:04.635689 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:04.636461 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:04.636906 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:04.766035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:04.773335 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-1c9527d7-936c-4dbd-ba32-4bb54c19231d tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.149671 May 11 19:08:04.773898 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 604/1187] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:04 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:05.789898 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:05.790499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:05.796881 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:05.797336 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:05.798101 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:05.798544 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:05.926766 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:05.934026 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8f12bd55-8316-4bae-a707-80c54fc2879c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1265 microversion: 2.1 time: 0.148015 May 11 19:08:05.934583 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 584/1188] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:05 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:06.951683 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:06.952285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:06.958989 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:06.959465 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:06.960216 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:06.960651 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:07.089004 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:07.096261 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-ec5365f1-2e22-4d5a-8650-08d5410cc8d6 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1452 microversion: 2.1 time: 0.148550 May 11 19:08:07.097494 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 605/1189] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:06 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:07.112738 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:07.113355 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:07.119737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:07.120193 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:07.120957 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:07.121396 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:07.252076 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:07.259974 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-55b535d5-ff32-45e4-912d-92b20b7d610b tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1452 microversion: 2.1 time: 0.151166 May 11 19:08:07.260538 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 585/1190] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:07 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:08.868455 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-4c88356e-aaaf-4c3e-b0dd-23323a8f2ed8 req-3aba4cbd-f448-411b-afe1-b8d9ce207544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703a0761-6018-4082-9de4-2dfdc3281996", "tag": "10f48d32-e534-425e-baeb-0f38e0869784"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:08:08.877066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4c88356e-aaaf-4c3e-b0dd-23323a8f2ed8 req-3aba4cbd-f448-411b-afe1-b8d9ce207544 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:08.877719 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-4c88356e-aaaf-4c3e-b0dd-23323a8f2ed8 req-3aba4cbd-f448-411b-afe1-b8d9ce207544 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:08.892994 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-4c88356e-aaaf-4c3e-b0dd-23323a8f2ed8 req-3aba4cbd-f448-411b-afe1-b8d9ce207544 service nova] Creating event network-changed:10f48d32-e534-425e-baeb-0f38e0869784 for instance 703a0761-6018-4082-9de4-2dfdc3281996 on hv-cinder-75510 May 11 19:08:08.898727 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-4c88356e-aaaf-4c3e-b0dd-23323a8f2ed8 req-3aba4cbd-f448-411b-afe1-b8d9ce207544 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033921 May 11 19:08:08.899732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 606/1191] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:08:12.881199 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:12.881685 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:12.888029 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:12.888476 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:12.889233 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:12.889672 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:12.972700 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.objects.instance [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lazy-loading 'services' on Instance uuid e55dbec2-5811-4945-898b-df01b351d4ea {{(pid=117097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 19:08:13.042234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-14c26bb2-a32d-47f3-84c7-22c1870d36eb tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea/os-volume_attachments/2248b7a1-2d92-4d35-baf9-4834b6d10200" status: 202 len: 0 microversion: 2.1 time: 0.165536 May 11 19:08:13.042834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 586/1192] 10.222.0.93 () {58 vars in 1415 bytes} [Wed May 11 19:08:12 2022] DELETE /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea/os-volume_attachments/2248b7a1-2d92-4d35-baf9-4834b6d10200 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:08:14.148863 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:14.149453 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:14.155661 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:14.156120 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:14.156916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:14.157353 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:14.181260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Going to try to terminate instance {{(pid=117096) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:08:14.257072 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4dab3d1d-bcd5-4be2-92ef-49525ffa269e tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 204 len: 0 microversion: 2.1 time: 0.113282 May 11 19:08:14.257673 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 607/1193] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:08:14 2022] DELETE /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:08:14.266714 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:14.267462 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:14.274339 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:14.274782 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:14.275566 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:14.276003 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:14.401867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:14.409222 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-bb47c9cd-128d-4a40-991e-50c05b4ffc98 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1514 microversion: 2.1 time: 0.147149 May 11 19:08:14.409785 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 587/1194] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:14 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:15.426660 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:15.427376 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:15.433624 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:15.434069 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:15.434821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:15.435249 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:15.564285 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:15.572391 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a146d2a2-4cec-482e-bd34-60dae9d6e594 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1514 microversion: 2.1 time: 0.149982 May 11 19:08:15.572967 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 608/1195] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:15 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:16.590734 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:16.591654 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:16.599051 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:16.599606 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:16.600633 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:16.601100 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:16.681983 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbb1e903f24becaede7f26b06845e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d43929ef2a74d3fb50580db2b83d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:08:16.684384 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-0532ed54-71ca-40d9-b05e-beec1a055dc6 req-bceb377c-1f64-4e7b-ba91-f5dde451e87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55dbec2-5811-4945-898b-df01b351d4ea", "name": "network-vif-deleted", "tag": "64b8c25a-5f35-40db-90d5-a821ebeffe1e"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:08:16.692834 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-fa1d0280-9191-4ae0-9df2-9801cdb37504 tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 200 len: 1472 microversion: 2.1 time: 0.106699 May 11 19:08:16.693532 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 588/1196] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:16 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:08:16.697405 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-0532ed54-71ca-40d9-b05e-beec1a055dc6 req-bceb377c-1f64-4e7b-ba91-f5dde451e87c service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:16.698993 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-0532ed54-71ca-40d9-b05e-beec1a055dc6 req-bceb377c-1f64-4e7b-ba91-f5dde451e87c service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:16.710955 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-0532ed54-71ca-40d9-b05e-beec1a055dc6 req-bceb377c-1f64-4e7b-ba91-f5dde451e87c service nova] Creating event network-vif-deleted:64b8c25a-5f35-40db-90d5-a821ebeffe1e for instance e55dbec2-5811-4945-898b-df01b351d4ea on hv-cinder-75510 May 11 19:08:16.716401 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-0532ed54-71ca-40d9-b05e-beec1a055dc6 req-bceb377c-1f64-4e7b-ba91-f5dde451e87c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104426 May 11 19:08:16.717271 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 609/1197] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:08:17.709952 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:08:17.710552 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] [instance: e55dbec2-5811-4945-898b-df01b351d4ea] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:08:17.716901 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:17.717341 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:17.718087 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:08:17.718515 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:08:17.732158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] HTTP exception thrown: Instance e55dbec2-5811-4945-898b-df01b351d4ea could not be found. May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Request method failure captured: May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea HTTP/1.1 May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAk7mD6iFgl7I9bvwEuc7cbHU4DvGto7TvoIkuLhaPOKojfOH9a_e-sNM3Sq45uaN2mJ54501WSE-mJFwPT5urwatO5iIpxQNCYxt1RwJyd98OjgGaXOlk5y5U2FFmyon--kj2FI6iwl6AuPXG8wmyq_CB8oVO7wGYEMUqmHHgHSbNs May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: 6d43929ef2a74d3fb50580db2b83d868 May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-VolumesSnapshotTestJSON-986153274 May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:08:17.733767 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6d43929ef2a74d3fb50580db2b83d868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d43929ef2a74d3fb50580db2b83d868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6d43929ef2a74d3fb50580db2b83d868", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6d43929ef2a74d3fb50580db2b83d868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-VolumesSnapshotTestJSON-986153274 May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: 6d43929ef2a74d3fb50580db2b83d868 May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-986153274 May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-VolumesSnapshotTestJSON-986153274-project May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: 36dbb1e903f24becaede7f26b06845e8 May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-VolumesSnapshotTestJSON-986153274-project May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance e55dbec2-5811-4945-898b-df01b351d4ea could not be found. May 11 19:08:17.735478 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'e55dbec2-5811-4945-898b-df01b351d4ea'} May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55dbec2-5811-4945-898b-df01b351d4ea could not be found. May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:08:17.736576 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55dbec2-5811-4945-898b-df01b351d4ea could not be found. May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55dbec2-5811-4945-898b-df01b351d4ea could not be found. May 11 19:08:17.738737 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:08:17.740391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] Returning 404 to user: Instance e55dbec2-5811-4945-898b-df01b351d4ea could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:08:17.740391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-1959516f-390e-4b30-ad44-21a74622a90f tempest-VolumesSnapshotTestJSON-986153274 tempest-VolumesSnapshotTestJSON-986153274-project] 10.222.0.93 "GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea" status: 404 len: 111 microversion: 2.1 time: 0.029056 May 11 19:08:17.740391 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 589/1198] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:08:17 2022] GET /compute/v2.1/servers/e55dbec2-5811-4945-898b-df01b351d4ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:09:47.163110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-73344735", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1150264539", "security_groups": [{"name": "tempest-secgroup-smoke-809237043"}], "block_device_mapping_v2": [{"uuid": "076e9b62-d8f2-4120-b17f-6c782d694fff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3cca2bc-d77d-445f-bc7f-2c39c608cd4e"}]}} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:09:47.271852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.network.neutron [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] validate_networks() for [('f3cca2bc-d77d-445f-bc7f-2c39c608cd4e', None, None, None, None, None)] {{(pid=117096) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 19:09:47.732322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Flavor limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 19:09:47.732745 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Image limits 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 19:09:47.733220 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Flavor pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 19:09:47.733631 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Image pref 0:0:0 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 19:09:47.734043 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.virt.hardware [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117096) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 19:09:47.743322 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:47.743767 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:47.744570 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:47.745009 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:47.761295 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 19:09:47.765202 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.quota [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Getting quotas for user ead71051e3c548e7989007c8f5d0abc0 and project aaad8f4e0e0b41c4b227a090b8260f61. Resources: {'ram', 'instances', 'cores'} {{(pid=117096) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 19:09:47.819868 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Going to run 1 instances... {{(pid=117096) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 19:09:47.822084 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='076e9b62-d8f2-4120-b17f-6c782d694fff',volume_size=None,volume_type=None)] {{(pid=117096) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 19:09:47.945942 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8ef877f8-1bb8-40b4-b6f4-cbc78bd44089 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788944 May 11 19:09:47.947173 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 610/1199] 10.222.0.93 () {60 vars in 1146 bytes} [Wed May 11 19:09:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 19:09:47.957978 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a81e91f9-02ce-4c6d-896e-f5de2074123c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:47.958720 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a81e91f9-02ce-4c6d-896e-f5de2074123c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:47.961387 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR oslo.messaging._drivers.impl_rabbit [-] [160b464f-a011-4013-b24c-9da95e7e820f] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 11 19:09:48.012717 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-a81e91f9-02ce-4c6d-896e-f5de2074123c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:48.019499 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a81e91f9-02ce-4c6d-896e-f5de2074123c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1093 microversion: 2.1 time: 0.065920 May 11 19:09:48.020058 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 590/1200] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:47 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:49.037766 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:49.038700 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:49.047911 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:49.048490 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:49.049550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:49.050200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:49.145374 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:49.153741 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-a00a72ae-60b6-4898-944b-52eb5e1fd6fe tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1209 microversion: 2.1 time: 0.120410 May 11 19:09:49.159326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 611/1201] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:49 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:50.171762 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:50.172376 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:50.182097 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:50.182557 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:50.183435 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:50.183808 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:50.203158 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO oslo.messaging._drivers.impl_rabbit [-] [160b464f-a011-4013-b24c-9da95e7e820f] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42776. May 11 19:09:50.319346 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:50.326965 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-80c4f5bc-5507-431d-9c61-ebbb5b3bb5c8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.159168 May 11 19:09:50.327564 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 591/1202] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:50 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:50.610345 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-08341a44-1e5b-4756-8089-ca59beb74ce6 req-3fbc0e59-a97b-46df-95d8-c8449328c9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164f68b1-9061-424b-a20f-51dd90371ea9", "tag": "7439193b-a840-4ec0-8d8a-75ccf772906d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:09:50.619682 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-08341a44-1e5b-4756-8089-ca59beb74ce6 req-3fbc0e59-a97b-46df-95d8-c8449328c9ce service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:50.620193 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-08341a44-1e5b-4756-8089-ca59beb74ce6 req-3fbc0e59-a97b-46df-95d8-c8449328c9ce service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:50.632074 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-08341a44-1e5b-4756-8089-ca59beb74ce6 req-3fbc0e59-a97b-46df-95d8-c8449328c9ce service nova] Creating event network-changed:7439193b-a840-4ec0-8d8a-75ccf772906d for instance 164f68b1-9061-424b-a20f-51dd90371ea9 on hv-cinder-75510 May 11 19:09:50.637618 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-08341a44-1e5b-4756-8089-ca59beb74ce6 req-3fbc0e59-a97b-46df-95d8-c8449328c9ce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031229 May 11 19:09:50.638214 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 612/1203] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:09:51.344496 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:51.345104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:51.352032 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:51.352483 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:51.353241 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:51.353675 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:51.482936 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:51.491276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2f2eb162-a421-4e40-9f8b-ca5fdcebe945 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.150718 May 11 19:09:51.491867 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 592/1204] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:51 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:52.509623 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:52.510238 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:52.516434 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:52.516891 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:52.517681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:52.518123 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:52.645048 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:52.652379 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-af0c6f63-a150-4e88-9040-8293fe1dbe9c tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.147502 May 11 19:09:52.652943 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 613/1205] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:52 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:53.669046 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:53.669665 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:53.676107 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:53.676561 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:53.677329 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:53.677769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:53.806877 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:53.814287 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-eaca82e7-d485-4665-8f5a-4c161ad8abd1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.149241 May 11 19:09:53.814861 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 593/1206] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:53 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:54.831809 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:54.832458 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:54.838781 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:54.839226 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:54.840011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:54.840444 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:54.971852 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:54.978998 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-4656c705-5bb1-42e0-b454-d3d1c804f5d1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.151104 May 11 19:09:54.979839 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 614/1207] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:54 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:55.995647 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:55.996265 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:56.002815 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:56.003269 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:56.004563 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:56.005000 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:56.131577 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:56.138793 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-aa73dbb8-8d5e-448f-b7d5-a17214190550 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.146994 May 11 19:09:56.139375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 594/1208] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:55 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:57.156221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:57.156789 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:57.163132 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:57.163606 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:57.164372 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:57.164808 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:57.294119 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:57.301916 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-90e492ef-0484-43dd-a4d5-5d653c9cfdd8 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.149630 May 11 19:09:57.302476 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 615/1209] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:57 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:58.318408 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:58.319005 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:58.325586 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:58.326038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:58.326786 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:58.327216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:58.457368 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:58.465313 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ff6fd56e-dd6f-4fa4-9f76-35c1f4f3e358 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.151187 May 11 19:09:58.465810 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 595/1210] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:58 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:09:59.481228 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:09:59.481785 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:09:59.488110 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:59.488563 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:59.489328 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:09:59.489787 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:09:59.618729 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:09:59.626169 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-50323fcb-01cd-4dba-be5f-725f727a3851 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.148977 May 11 19:09:59.626784 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 616/1211] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:09:59 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:10:00.643650 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:10:00.644430 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:10:00.651352 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:00.652066 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:00.652834 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:00.653272 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:00.677295 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-7e9dbfcf-5370-418a-9e8a-a4222bc74ae1 req-1760b5e4-06ea-457b-b3e5-fbab70e78aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164f68b1-9061-424b-a20f-51dd90371ea9", "name": "network-vif-plugged", "status": "completed", "tag": "7439193b-a840-4ec0-8d8a-75ccf772906d"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:10:00.685292 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7e9dbfcf-5370-418a-9e8a-a4222bc74ae1 req-1760b5e4-06ea-457b-b3e5-fbab70e78aeb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:00.685736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-7e9dbfcf-5370-418a-9e8a-a4222bc74ae1 req-1760b5e4-06ea-457b-b3e5-fbab70e78aeb service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:00.697497 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-7e9dbfcf-5370-418a-9e8a-a4222bc74ae1 req-1760b5e4-06ea-457b-b3e5-fbab70e78aeb service nova] Creating event network-vif-plugged:7439193b-a840-4ec0-8d8a-75ccf772906d for instance 164f68b1-9061-424b-a20f-51dd90371ea9 on hv-cinder-75510 May 11 19:10:00.702961 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-7e9dbfcf-5370-418a-9e8a-a4222bc74ae1 req-1760b5e4-06ea-457b-b3e5-fbab70e78aeb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155262 May 11 19:10:00.703890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 596/1212] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:10:00.787567 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:10:00.794950 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-d96f6e02-28e0-48c6-aeda-5af2e45769cd tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.155233 May 11 19:10:00.795555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 617/1213] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:10:00 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:10:01.812736 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:10:01.813442 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:10:01.820157 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:01.820614 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:01.821381 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:01.821824 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:01.950180 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:10:01.957560 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-b4fd23a5-c4e0-4e24-bc16-3abf7a804a0e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1264 microversion: 2.1 time: 0.149035 May 11 19:10:01.958118 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 597/1214] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:10:01 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:10:02.974724 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:10:02.975369 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:10:02.981746 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:02.982203 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:02.982978 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:02.983447 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:03.112797 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:10:03.122948 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-8491c95d-2ec6-4db8-b150-5dd3b8572f45 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1451 microversion: 2.1 time: 0.151843 May 11 19:10:03.123681 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 618/1215] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:10:02 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:10:03.140104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:10:03.140712 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:10:03.147047 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:03.147539 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:03.148305 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:03.148741 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:03.282188 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:10:03.289535 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-2d11e68d-3b8d-46d2-a180-5539683866b5 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1451 microversion: 2.1 time: 0.153310 May 11 19:10:03.290099 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 598/1216] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:10:03 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:10:04.955873 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-773d831a-3447-437a-bee3-86e20d6c1c61 req-7f4a2975-2394-44b0-99f7-b365b0f429e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164f68b1-9061-424b-a20f-51dd90371ea9", "tag": "7439193b-a840-4ec0-8d8a-75ccf772906d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:10:04.963776 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-773d831a-3447-437a-bee3-86e20d6c1c61 req-7f4a2975-2394-44b0-99f7-b365b0f429e8 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:10:04.964321 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-773d831a-3447-437a-bee3-86e20d6c1c61 req-7f4a2975-2394-44b0-99f7-b365b0f429e8 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:10:04.975762 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-773d831a-3447-437a-bee3-86e20d6c1c61 req-7f4a2975-2394-44b0-99f7-b365b0f429e8 service nova] Creating event network-changed:7439193b-a840-4ec0-8d8a-75ccf772906d for instance 164f68b1-9061-424b-a20f-51dd90371ea9 on hv-cinder-75510 May 11 19:10:04.980892 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-773d831a-3447-437a-bee3-86e20d6c1c61 req-7f4a2975-2394-44b0-99f7-b365b0f429e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088512 May 11 19:10:04.981498 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 619/1217] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:11:05.039817 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:11:05.040458 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Wed May 11 19:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:11:08.965975 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:11:08.966502 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Wed May 11 19:11:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:11:34.005110 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:34.005754 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:34.008575 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-22d91591-d747-487a-98f5-1709e76dcecf req-362b687f-577f-4be8-a87b-d10c48aa93ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164f68b1-9061-424b-a20f-51dd90371ea9", "tag": "7439193b-a840-4ec0-8d8a-75ccf772906d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:11:34.011662 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:34.012115 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:34.012890 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:34.013333 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:34.017188 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-22d91591-d747-487a-98f5-1709e76dcecf req-362b687f-577f-4be8-a87b-d10c48aa93ba service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:34.018760 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-22d91591-d747-487a-98f5-1709e76dcecf req-362b687f-577f-4be8-a87b-d10c48aa93ba service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:34.029118 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-22d91591-d747-487a-98f5-1709e76dcecf req-362b687f-577f-4be8-a87b-d10c48aa93ba service nova] Creating event network-changed:7439193b-a840-4ec0-8d8a-75ccf772906d for instance 164f68b1-9061-424b-a20f-51dd90371ea9 on hv-cinder-75510 May 11 19:11:34.034396 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-22d91591-d747-487a-98f5-1709e76dcecf req-362b687f-577f-4be8-a87b-d10c48aa93ba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031496 May 11 19:11:34.035221 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 620/1218] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:11:34.040607 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:11:34.124055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-c64b5653-8abc-434f-b829-b1c231fb8d28 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "DELETE /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 204 len: 0 microversion: 2.1 time: 0.123562 May 11 19:11:34.124715 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 599/1219] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:11:33 2022] DELETE /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:11:34.134391 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:34.135092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:34.141896 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:34.142403 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:34.143191 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:34.143652 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:34.307762 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:11:34.315027 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f0748c10-ace4-4d65-84b1-1796be632180 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1575 microversion: 2.1 time: 0.184998 May 11 19:11:34.315625 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 621/1220] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:34 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:11:35.333791 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:35.334425 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:35.340769 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:35.341216 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:35.341997 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:35.342455 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:35.472764 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:11:35.480273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-76058ef6-d78b-49e9-ad46-2549a5538475 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1575 microversion: 2.1 time: 0.150817 May 11 19:11:35.480846 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 600/1221] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:35 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:11:36.347790 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-84d6088e-53d2-4472-9dac-b4df9ed8bfa2 req-e582862f-43eb-4806-b68d-b2d658f9110a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164f68b1-9061-424b-a20f-51dd90371ea9", "name": "network-vif-deleted", "tag": "7439193b-a840-4ec0-8d8a-75ccf772906d"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:11:36.356385 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-84d6088e-53d2-4472-9dac-b4df9ed8bfa2 req-e582862f-43eb-4806-b68d-b2d658f9110a service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:36.356860 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-84d6088e-53d2-4472-9dac-b4df9ed8bfa2 req-e582862f-43eb-4806-b68d-b2d658f9110a service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:36.368294 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-84d6088e-53d2-4472-9dac-b4df9ed8bfa2 req-e582862f-43eb-4806-b68d-b2d658f9110a service nova] Creating event network-vif-deleted:7439193b-a840-4ec0-8d8a-75ccf772906d for instance 164f68b1-9061-424b-a20f-51dd90371ea9 on hv-cinder-75510 May 11 19:11:36.373555 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-84d6088e-53d2-4472-9dac-b4df9ed8bfa2 req-e582862f-43eb-4806-b68d-b2d658f9110a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029266 May 11 19:11:36.374211 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 622/1222] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:11:36.497788 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:36.498403 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:36.505375 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:36.505827 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:36.506599 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:36.507038 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:36.571437 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:11:36.579055 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-ee19ea0b-2b67-4e27-ace2-4a0dfac4c4ce tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 200 len: 1224 microversion: 2.1 time: 0.085132 May 11 19:11:36.579661 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 601/1223] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:36 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:11:37.597011 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:37.597740 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 164f68b1-9061-424b-a20f-51dd90371ea9] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:37.604200 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:37.604734 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:37.605600 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:37.606075 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:37.621899 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] HTTP exception thrown: Instance 164f68b1-9061-424b-a20f-51dd90371ea9 could not be found. May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Request method failure captured: May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 HTTP/1.1 May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAjFPL7D7BAh0kYTNyWss0F6wwVwgFVx-EUI2acj4ipyFbeMtGyynk0IVU7npJQ9RAXkXlrElGJSrq_9NzRrefGHBU2Xjoa1cicQ3znqGhi99HWPBe7cfeiNzDLTna5oqzXl_EIA4Te5Q9qXdG9Gi55vdogsNFiz4qAR0FFFTdL6T-w May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:11:37.623550 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aaad8f4e0e0b41c4b227a090b8260f61", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: ead71051e3c548e7989007c8f5d0abc0 May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance 164f68b1-9061-424b-a20f-51dd90371ea9 could not be found. May 11 19:11:37.625281 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': '164f68b1-9061-424b-a20f-51dd90371ea9'} May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164f68b1-9061-424b-a20f-51dd90371ea9 could not be found. May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:11:37.626236 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164f68b1-9061-424b-a20f-51dd90371ea9 could not be found. May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164f68b1-9061-424b-a20f-51dd90371ea9 could not be found. May 11 19:11:37.627880 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:37.629365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Returning 404 to user: Instance 164f68b1-9061-424b-a20f-51dd90371ea9 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:11:37.629365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-341fe71c-3126-4306-a122-86158bfc216e tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9" status: 404 len: 111 microversion: 2.1 time: 0.032644 May 11 19:11:37.629365 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 623/1224] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:37 2022] GET /compute/v2.1/servers/164f68b1-9061-424b-a20f-51dd90371ea9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:11:40.956009 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:40.956587 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:40.958605 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [req-3e3e22b7-9a3a-4036-b792-9d1a85cc2ff8 req-a8a817fd-bc7d-4d15-82e8-f6f32b3491d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703a0761-6018-4082-9de4-2dfdc3281996", "tag": "10f48d32-e534-425e-baeb-0f38e0869784"}]} {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:11:40.963620 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:40.964387 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:40.965234 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:40.965675 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:40.967545 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-3e3e22b7-9a3a-4036-b792-9d1a85cc2ff8 req-a8a817fd-bc7d-4d15-82e8-f6f32b3491d3 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:40.968062 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [req-3e3e22b7-9a3a-4036-b792-9d1a85cc2ff8 req-a8a817fd-bc7d-4d15-82e8-f6f32b3491d3 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:40.979954 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.compute.server_external_events [req-3e3e22b7-9a3a-4036-b792-9d1a85cc2ff8 req-a8a817fd-bc7d-4d15-82e8-f6f32b3491d3 service nova] Creating event network-changed:10f48d32-e534-425e-baeb-0f38e0869784 for instance 703a0761-6018-4082-9de4-2dfdc3281996 on hv-cinder-75510 May 11 19:11:40.985441 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [req-3e3e22b7-9a3a-4036-b792-9d1a85cc2ff8 req-a8a817fd-bc7d-4d15-82e8-f6f32b3491d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030512 May 11 19:11:40.986035 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 624/1225] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 19:11:40.994196 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Going to try to terminate instance {{(pid=117097) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 19:11:41.080317 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-23cde719-9c53-41a8-bc76-fd887021adec tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "DELETE /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 204 len: 0 microversion: 2.1 time: 0.127819 May 11 19:11:41.084646 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 602/1226] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:11:40 2022] DELETE /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 19:11:41.091326 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:41.092051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:41.099106 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:41.099597 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:41.100392 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:41.100821 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:41.260871 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:11:41.268340 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-f39ac2f4-fbe0-4253-ba94-e3bbfa7a0636 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1577 microversion: 2.1 time: 0.182796 May 11 19:11:41.268886 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 625/1227] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:41 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 19:11:42.287786 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:42.288486 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:42.294773 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:42.295249 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:42.296048 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:42.296484 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:42.430276 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.policy [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117097) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:11:42.438039 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-8c61a94f-0737-4953-82b9-7ebb4900a531 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1577 microversion: 2.1 time: 0.154586 May 11 19:11:42.438602 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 603/1228] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:42 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:11:43.455435 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:43.456088 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:43.463836 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:43.464505 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:43.465477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:43.465922 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:43.512128 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [req-329f4138-122b-4d52-b44e-973941c277d0 req-b6d9a59b-6362-46e1-a5ca-51fbde330d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703a0761-6018-4082-9de4-2dfdc3281996", "name": "network-vif-deleted", "tag": "10f48d32-e534-425e-baeb-0f38e0869784"}]} {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 19:11:43.520570 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-329f4138-122b-4d52-b44e-973941c277d0 req-b6d9a59b-6362-46e1-a5ca-51fbde330d23 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:43.521103 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [req-329f4138-122b-4d52-b44e-973941c277d0 req-b6d9a59b-6362-46e1-a5ca-51fbde330d23 service nova] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:43.533639 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.compute.server_external_events [req-329f4138-122b-4d52-b44e-973941c277d0 req-b6d9a59b-6362-46e1-a5ca-51fbde330d23 service nova] Creating event network-vif-deleted:10f48d32-e534-425e-baeb-0f38e0869784 for instance 703a0761-6018-4082-9de4-2dfdc3281996 on hv-cinder-75510 May 11 19:11:43.536483 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.policy [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead71051e3c548e7989007c8f5d0abc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaad8f4e0e0b41c4b227a090b8260f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117096) authorize /opt/stack/nova/nova/policy.py:199}} May 11 19:11:43.538886 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [req-329f4138-122b-4d52-b44e-973941c277d0 req-b6d9a59b-6362-46e1-a5ca-51fbde330d23 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 May 11 19:11:43.539511 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 604/1229] 10.222.0.93 () {64 vars in 1317 bytes} [Wed May 11 19:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 19:11:43.545477 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-b55cd01d-d30e-4750-ae30-4900f6215e59 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 200 len: 1391 microversion: 2.1 time: 0.093859 May 11 19:11:43.546050 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 626/1230] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:43 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 19:11:44.563248 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:44.563892 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: 703a0761-6018-4082-9de4-2dfdc3281996] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:44.570064 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:44.570516 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:44.571273 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:44.571731 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:44.585359 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] HTTP exception thrown: Instance 703a0761-6018-4082-9de4-2dfdc3281996 could not be found. May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Request method failure captured: May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 HTTP/1.1 May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAjFPL7D7BAh0kYTNyWss0F6wwVwgFVx-EUI2acj4ipyFbeMtGyynk0IVU7npJQ9RAXkXlrElGJSrq_9NzRrefGHBU2Xjoa1cicQ3znqGhi99HWPBe7cfeiNzDLTna5oqzXl_EIA4Te5Q9qXdG9Gi55vdogsNFiz4qAR0FFFTdL6T-w May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:11:44.586934 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aaad8f4e0e0b41c4b227a090b8260f61", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: ead71051e3c548e7989007c8f5d0abc0 May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance 703a0761-6018-4082-9de4-2dfdc3281996 could not be found. May 11 19:11:44.588571 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': '703a0761-6018-4082-9de4-2dfdc3281996'} May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703a0761-6018-4082-9de4-2dfdc3281996 could not be found. May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:11:44.589648 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703a0761-6018-4082-9de4-2dfdc3281996 could not be found. May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703a0761-6018-4082-9de4-2dfdc3281996 could not be found. May 11 19:11:44.591149 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:44.592728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Returning 404 to user: Instance 703a0761-6018-4082-9de4-2dfdc3281996 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:11:44.592728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-dc0a7197-5c8f-48e8-804e-f1d5f36935f3 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996" status: 404 len: 111 microversion: 2.1 time: 0.029863 May 11 19:11:44.592728 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 605/1231] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:44 2022] GET /compute/v2.1/servers/703a0761-6018-4082-9de4-2dfdc3281996 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:11:45.022516 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:45.023076 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.compute.api [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117096) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:45.029381 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:45.029836 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:45.030604 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:45.031071 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG oslo_concurrency.lockutils [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:45.044092 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.wsgi [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] HTTP exception thrown: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Request method failure captured: May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: request: DELETE /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 HTTP/1.1 May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept: application/json May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Accept-Encoding: identity May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Connection: close May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Length: 0 May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Content-Type: application/json May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Host: 10.222.0.93 May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Openstack-System-Scope: None May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: User-Agent: python-urllib3/1.26.9 May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Auth-Token: gAAAAABifAjFPL7D7BAh0kYTNyWss0F6wwVwgFVx-EUI2acj4ipyFbeMtGyynk0IVU7npJQ9RAXkXlrElGJSrq_9NzRrefGHBU2Xjoa1cicQ3znqGhi99HWPBe7cfeiNzDLTna5oqzXl_EIA4Te5Q9qXdG9Gi55vdogsNFiz4qAR0FFFTdL6T-w May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Id: None May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Domain-Name: None May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Identity-Status: Confirmed May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Is-Admin-Project: True May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Id: default May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Domain-Name: Default May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Project-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Role: reader,member May 11 19:11:45.045711 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Roles: reader,member May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aaad8f4e0e0b41c4b227a090b8260f61", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Id: default May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Domain-Name: Default May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Id: ead71051e3c548e7989007c8f5d0abc0 May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: X-User-Name: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: method: > May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: exception: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.047337 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: action_args: {'id': 'd0ffc6c7-d651-46de-871e-3ad46ec97a88'} May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:11:45.048253 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.049744 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: ERROR nova.api.openstack.wsgi May 11 19:11:45.051178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Returning 404 to user: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. {{(pid=117096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:11:45.051178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-53817e8d-3f59-42fe-9664-dc131749d2e1 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 404 len: 111 microversion: 2.1 time: 0.028610 May 11 19:11:45.051178 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 627/1232] 10.222.0.93 () {58 vars in 1238 bytes} [Wed May 11 19:11:45 2022] DELETE /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:11:45.056166 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '>' {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:45.056807 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.compute.api [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] [instance: d0ffc6c7-d651-46de-871e-3ad46ec97a88] Fetching instance by UUID {{(pid=117097) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 19:11:45.062581 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:45.063030 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:45.063826 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 19:11:45.064263 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG oslo_concurrency.lockutils [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Lock "40d0ea05-af06-458f-98eb-de2bb03f4480" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 19:11:45.078230 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.wsgi [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] HTTP exception thrown: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Request method failure captured: May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: request: GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 HTTP/1.1 May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept: application/json May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Accept-Encoding: identity May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Connection: close May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Length: 0 May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Content-Type: application/json May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Host: 10.222.0.93 May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Openstack-System-Scope: None May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: User-Agent: python-urllib3/1.26.9 May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Auth-Token: gAAAAABifAjFPL7D7BAh0kYTNyWss0F6wwVwgFVx-EUI2acj4ipyFbeMtGyynk0IVU7npJQ9RAXkXlrElGJSrq_9NzRrefGHBU2Xjoa1cicQ3znqGhi99HWPBe7cfeiNzDLTna5oqzXl_EIA4Te5Q9qXdG9Gi55vdogsNFiz4qAR0FFFTdL6T-w May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Id: None May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Domain-Name: None May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Identity-Status: Confirmed May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Is-Admin-Project: True May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Id: default May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Domain-Name: Default May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Project-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Role: reader,member May 11 19:11:45.079759 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Roles: reader,member May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aaad8f4e0e0b41c4b227a090b8260f61", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aaad8f4e0e0b41c4b227a090b8260f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Id: aaad8f4e0e0b41c4b227a090b8260f61 May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667792582 May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Id: default May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Domain-Name: Default May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Id: ead71051e3c548e7989007c8f5d0abc0 May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: X-User-Name: tempest-TestVolumeBootPattern-1667792582-project May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: method: > May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: exception: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.081306 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: action_args: {'id': 'd0ffc6c7-d651-46de-871e-3ad46ec97a88'} May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: {{(pid=117097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 19:11:45.082189 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. May 11 19:11:45.084947 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: ERROR nova.api.openstack.wsgi May 11 19:11:45.086344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: DEBUG nova.api.openstack.wsgi [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Returning 404 to user: Instance d0ffc6c7-d651-46de-871e-3ad46ec97a88 could not be found. {{(pid=117097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 19:11:45.086344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO nova.api.openstack.requestlog [None req-a251e397-b512-4167-ba13-26b0aa88efea tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88" status: 404 len: 111 microversion: 2.1 time: 0.029443 May 11 19:11:45.086344 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: [pid: 117097|app: 0|req: 606/1233] 10.222.0.93 () {58 vars in 1235 bytes} [Wed May 11 19:11:45 2022] GET /compute/v2.1/servers/d0ffc6c7-d651-46de-871e-3ad46ec97a88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 19:11:46.365014 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: DEBUG nova.api.openstack.wsgi [None req-342998de-a4f9-4d7a-9cec-ab29f0903f49 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] Calling method '.version_select at 0x7fa78777adc0>' {{(pid=117096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 19:11:46.386885 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO nova.api.openstack.requestlog [None req-342998de-a4f9-4d7a-9cec-ab29f0903f49 tempest-TestVolumeBootPattern-1667792582 tempest-TestVolumeBootPattern-1667792582-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1150264539" status: 202 len: 0 microversion: 2.1 time: 0.025831 May 11 19:11:46.387514 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: [pid: 117096|app: 0|req: 628/1234] 10.222.0.93 () {58 vars in 1262 bytes} [Wed May 11 19:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1150264539 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 19:12:36.131051 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:12:36.131803 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Wed May 11 19:12:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:12:58.969640 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:12:58.970104 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Wed May 11 19:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:14:25.047732 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:14:25.048199 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Wed May 11 19:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:14:28.976761 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:14:28.977457 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Wed May 11 19:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:14:38.396527 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:14:38.397594 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Wed May 11 19:14:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:14:47.140847 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:14:47.141585 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Wed May 11 19:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:15:56.139260 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:15:56.139901 dv-cinder-755101-8-iscsi devstack@n-api.service[117096]: Wed May 11 19:15:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 19:16:18.977925 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 19:16:18.978522 dv-cinder-755101-8-iscsi devstack@n-api.service[117097]: Wed May 11 19:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!